-- Logs begin at Tue 2021-10-12 17:30:35 UTC, end at Tue 2021-10-12 18:48:21 UTC. -- Oct 12 18:16:38.405169 dv-cinder-813227-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 12 18:16:38.413997 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 12 18:16:38.416091 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 12 18:16:38 2021] *** Oct 12 18:16:38.416091 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 12 18:16:38.416091 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 12 18:16:38.416091 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: nodename: dv-cinder-813227-2-iscsi Oct 12 18:16:38.416091 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: machine: x86_64 Oct 12 18:16:38.416091 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: clock source: unix Oct 12 18:16:38.416091 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: pcre jit disabled Oct 12 18:16:38.416091 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: detected number of CPU cores: 4 Oct 12 18:16:38.416091 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: current working directory: / Oct 12 18:16:38.416091 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: detected binary path: /usr/bin/uwsgi-core Oct 12 18:16:38.416091 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: your processes number limit is 47680 Oct 12 18:16:38.416091 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: your memory page size is 4096 bytes Oct 12 18:16:38.416091 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: detected max file descriptor number: 2048 Oct 12 18:16:38.416091 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: lock engine: pthread robust mutexes Oct 12 18:16:38.417451 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: thunder lock: enabled Oct 12 18:16:38.417451 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 12 18:16:38.417451 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 12 18:16:38.468300 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: Python main interpreter initialized at 0x55681159e9c0 Oct 12 18:16:38.468300 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: python threads support enabled Oct 12 18:16:38.468300 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: your server socket listen backlog is limited to 100 connections Oct 12 18:16:38.468300 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: your mercy for graceful operations on workers is 90 seconds Oct 12 18:16:38.468733 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: mapped 403077 bytes (393 KB) for 2 cores Oct 12 18:16:38.468733 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: *** Operational MODE: preforking *** Oct 12 18:16:38.469035 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: *** uWSGI is running in multiple interpreter mode *** Oct 12 18:16:38.469035 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: spawned uWSGI master process (pid: 94139) Oct 12 18:16:38.469250 dv-cinder-813227-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 12 18:16:38.469826 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: spawned uWSGI worker 1 (pid: 94140, cores: 1) Oct 12 18:16:38.470164 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: spawned uWSGI worker 2 (pid: 94141, cores: 1) Oct 12 18:16:38.470327 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 12 18:16:40.127210 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 18:16:40.127210 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: from cryptography.utils import int_from_bytes Oct 12 18:16:40.127905 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 18:16:40.127905 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: from cryptography.utils import int_from_bytes Oct 12 18:16:40.135508 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 18:16:40.135508 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: from cryptography.utils import int_from_bytes Oct 12 18:16:40.136005 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 18:16:40.136005 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: from cryptography.utils import int_from_bytes Oct 12 18:16:42.804674 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 18:16:42.805322 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 18:16:42.805413 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 18:16:42.805741 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 18:16:42.805994 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 18:16:42.806378 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.807237 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.807580 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.807898 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.808249 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.808592 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.808911 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.809231 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.809558 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.809717 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 18:16:42.810137 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.810226 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 18:16:42.810300 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.810434 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813227-2-iscsi {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.810576 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 18:16:42.810751 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.810849 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 18:16:42.811027 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 18:16:42.811112 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.811352 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.811442 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.811669 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.811805 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.811973 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.812069 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.812294 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.812378 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.812633 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.812735 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.812951 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.813127 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.813271 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.813570 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.813693 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.813881 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.814002 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.814157 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.814279 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.814467 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.814613 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.814772 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813227-2-iscsi {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.814901 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.815093 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.815178 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.815400 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.815499 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.815710 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.815795 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.816026 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.816119 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.816329 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.816441 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.816673 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.816808 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813227-2-iscsi {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.816979 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.817073 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.817365 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.817458 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.817682 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.817774 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.818059 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.818150 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.818369 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.818466 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.818703 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.818817 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.819019 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.819145 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.819327 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.819533 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.819722 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.819915 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.820095 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.820206 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.820310 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.820440 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.820572 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.820795 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.820951 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813227-2-iscsi {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.821039 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.821266 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.821353 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.821578 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.821670 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.821891 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.821988 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.822209 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.822331 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.823080 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.823171 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.823391 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.823485 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.823645 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.823771 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.823962 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.824088 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.824289 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.824419 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.824666 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.824763 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.824992 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.825090 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.825251 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.825364 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.825498 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.825633 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.825812 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.825936 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.826133 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.826224 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.826444 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.826536 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.826755 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.826852 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.827063 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.827148 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.827370 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.827462 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.827642 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.827741 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.827946 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.828030 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.828263 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.828347 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.828595 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.828690 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.828913 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.828998 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.829225 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.829314 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.829477 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.829569 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.829795 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.829887 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.830117 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.830214 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.830424 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.830539 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.830733 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.830839 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.831035 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.831130 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.831339 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.831416 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.831645 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.831740 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.831951 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.832091 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.832259 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.832352 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.832600 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.832695 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.832917 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.833045 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.833227 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.833316 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.833534 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.833618 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.833843 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.833944 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.834163 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.834259 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.834476 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.834561 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.834729 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.834824 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.835032 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.835118 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.835348 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.835440 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.835667 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.835760 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.836003 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.836103 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.836314 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.836482 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.836658 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.836795 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.836965 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.837051 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.837272 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.837365 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.837576 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.837759 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.837925 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.838026 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.838265 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.838351 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.838570 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.838658 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.838818 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.838910 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.839116 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.839208 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.840015 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.840134 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.840218 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.840307 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.840388 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.840509 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.840597 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.840676 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.840760 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.840838 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.840906 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.841050 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.841202 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.841289 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.841505 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.841597 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.841808 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.841903 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.842110 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.842195 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.842413 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.842498 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.842715 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.842808 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.843017 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.843111 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.843320 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.843411 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.843621 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.843715 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.843925 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.844009 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.844238 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.844353 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.844565 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.844681 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.844869 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.844961 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.845168 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.845260 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.845470 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.845573 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.845781 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.845925 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.846081 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.846165 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.846383 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.846475 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.846687 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.846779 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.846992 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.847097 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.847294 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.847387 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.847598 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.847692 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.847897 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.847990 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.848192 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.848284 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.848536 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.848630 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.848835 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.848927 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.849139 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.849233 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.849446 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.849539 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.849749 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.849852 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.850053 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.850147 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.850355 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.850448 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.850657 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.850760 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.850964 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.851114 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.851263 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.851351 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.851564 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.851665 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.851865 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.851950 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.852160 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.852293 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.852501 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.852606 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.852825 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.852911 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.853132 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.853217 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.853437 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.853530 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.853777 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.853863 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.854095 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:16:42.854181 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.854431 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.854528 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.854748 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.854832 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.855078 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.855163 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.855391 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.855477 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.855704 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.855794 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.856026 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.856115 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.856352 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.856487 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.856675 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.856759 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.856991 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.857100 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.857316 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.857411 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.857616 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.857716 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.857917 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.858035 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.858229 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.858308 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.858545 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.858620 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.858861 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.858937 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.859191 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.859288 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.859501 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.859576 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.859814 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.859887 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.860127 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.860205 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.860460 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.860548 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.860777 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.860889 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.861093 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.861243 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.861407 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.861501 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.861710 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.861807 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.862051 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.862167 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.862366 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.862502 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.862675 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.862772 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.862983 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.863069 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.863290 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.863383 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.863600 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.863697 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.863907 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.864001 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.864213 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.864298 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.864548 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.864654 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.864863 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.864954 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.865175 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.865260 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.865485 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.865572 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.865801 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.865884 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.866114 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.866202 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.866467 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.866561 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.866721 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.866805 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.867024 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.867108 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.867327 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.867414 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.867640 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.867746 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.867943 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.868048 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.868252 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.868440 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.868583 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.868743 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.868903 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.869052 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.869871 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.870016 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.870170 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.870318 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.870457 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.870606 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.870747 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.870870 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.871017 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.871159 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.871369 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.871528 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.871674 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.871796 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.871936 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.872045 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.872127 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.872282 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.872496 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.872606 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.872801 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.872890 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.873126 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.873214 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.873452 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.873537 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.873771 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.873856 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.874079 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.874165 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.874385 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.874477 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.874688 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.874776 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.874993 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.875079 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.875300 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.875390 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.875605 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.875691 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.875908 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.875996 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.876214 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.876310 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.876545 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.876635 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.876850 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.876938 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.877153 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.877237 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.877474 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.877566 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.877786 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.877896 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.878091 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.878189 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.878392 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.878485 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.878690 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.878773 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.878992 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.879082 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.879293 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.879377 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.879601 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.879682 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.879901 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.879976 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.880204 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.880364 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.880545 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.880624 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.880844 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.880927 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.881145 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.881228 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.881466 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.881548 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.881776 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.881870 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.882076 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.882162 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.882637 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.882740 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.882821 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.882953 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.883050 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.883132 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.883345 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.883442 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.883671 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.883772 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.883992 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.884088 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.884303 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.884390 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.884648 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.884733 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.885539 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.885660 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.885853 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.885935 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.886166 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.886250 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.886478 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.886552 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.886786 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.886861 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.887096 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.887178 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.887413 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.887495 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.887720 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.887795 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.888032 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.888127 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.888339 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.888462 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.888677 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.888762 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.888986 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.889076 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.889302 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.889376 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.889608 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.889683 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.889924 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.890018 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.890237 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.890323 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.890561 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.890646 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.890870 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.890958 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.891186 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.891270 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.891488 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.891584 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.891800 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.891885 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.892110 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.892195 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.892466 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.892568 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.892748 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.892839 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.893055 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.893148 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.893371 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.893456 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.893680 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.893766 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.893992 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.894085 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.894298 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.894382 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.894602 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.894687 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.894910 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.895001 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.895222 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.895315 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.895525 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.895610 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.895839 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.895924 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.896417 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.896524 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.896735 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.896820 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.897053 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.897137 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.897360 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.897453 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.897664 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.897769 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.897975 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.898170 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.898277 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.898373 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.898571 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.898657 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.898874 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.898971 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.899179 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.899274 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.899489 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.899574 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.899796 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.899915 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.900102 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.900189 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.900452 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.900543 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.900762 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.900847 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.901078 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.901166 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.901380 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.901464 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.901682 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.901765 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.901985 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.902078 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.902294 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.902378 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.902607 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.902697 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.902912 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.902997 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.903230 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.903315 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.903539 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.903631 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.903845 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.903929 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.904147 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.904231 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.904473 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.904577 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.904788 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.904872 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.905090 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.905174 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.905391 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.905488 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.905738 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.905832 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.906003 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.906095 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.906314 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.906410 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.906614 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.906698 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.906935 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.907037 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.907237 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.907323 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.907543 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.907672 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.907849 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.907932 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.908154 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.908231 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.908483 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.908569 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.908806 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.908895 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.909104 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.909381 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.909469 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.909705 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.909789 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.910015 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.910184 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.910323 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.910409 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.910631 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.910716 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.910950 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.911047 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.911255 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.911347 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.911564 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.911657 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.911872 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.911962 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.912176 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.912270 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.912508 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.912595 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.912816 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.912909 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.913124 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.913381 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.913473 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.913719 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.913818 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.914024 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.914107 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.914331 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.914416 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.914643 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.914741 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.914948 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.915033 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.915252 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.915337 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.915583 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.915668 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.915893 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.916036 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.916225 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.916312 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.916557 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.916646 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.916863 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.916991 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.917163 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.917248 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.917471 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.917564 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.917776 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.917862 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.918077 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.918160 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.918376 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.918468 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.918679 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.918762 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.918979 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.919118 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.919279 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.919374 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.919611 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.919696 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.919914 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.920008 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.920226 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.920312 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.920552 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.920640 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.920862 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.920961 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.921165 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.921258 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.921484 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.921570 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.921784 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.921915 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.922082 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.922168 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.922384 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.922470 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.922685 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.922782 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.922984 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.923070 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.923298 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.923427 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.923608 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.923694 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.923918 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.924016 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.924229 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.924319 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.924560 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.924688 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.924871 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.925052 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.925177 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.925265 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.925476 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.925561 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.925778 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.925872 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.926081 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.926191 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.926381 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.926473 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.926683 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.926778 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.926982 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.927067 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.927281 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.927365 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.927585 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.927671 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.927885 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.927976 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.928190 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.928281 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.928515 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.928607 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.928819 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.928915 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.929118 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.929222 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.929426 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.929511 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.929731 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.929815 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.930030 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.930122 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.930329 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.930414 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.930638 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.930723 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.930942 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.931033 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.931238 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.931324 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.931543 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.932170 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.932370 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.932527 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.932706 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.932792 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.933005 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.933350 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.933475 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.933589 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.933704 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.933792 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.933895 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.933980 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.934202 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.934366 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.934506 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.934590 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.934812 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.934915 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.935113 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.935208 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.935413 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.935496 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.935719 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.935803 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.936016 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.936108 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.936317 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.936461 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.936643 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.936727 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.936960 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.937046 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.937266 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.937356 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.937565 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.937649 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.937867 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.937951 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.938165 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.938248 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.938467 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.938551 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.938769 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.938874 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.939077 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.939187 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.939379 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.939478 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.939677 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.939770 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.939978 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.940064 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.940278 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.940370 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.940620 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.940708 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.940943 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.941028 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.941247 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.941339 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.941545 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.941629 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.941848 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.941935 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.942147 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.942245 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.942451 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.942538 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.942757 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.942842 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.943080 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.943175 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.943394 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.943487 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.943707 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.943835 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.944023 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.944116 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.944334 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.944480 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.944671 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.944756 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.944973 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.945058 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.945277 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.945367 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.945585 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.945668 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.945892 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.945977 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.946200 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.946284 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.946500 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.946583 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.946803 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.946889 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.947113 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.947197 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.947983 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.948135 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.948292 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.948379 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.948631 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.948720 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.948939 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.949024 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.949253 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.949342 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.949555 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.949651 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.949886 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.949993 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.950162 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.950247 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.950473 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.950576 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.950773 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.950874 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.951078 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.951201 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.951379 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.951470 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.951684 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.951777 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.951984 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.952075 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.952290 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.952446 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.952623 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.952763 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.952927 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.953075 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.953238 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.953380 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.953685 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.953826 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.953905 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.953972 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.954157 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.954288 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.954467 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.954603 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.954772 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.954905 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.955081 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.955326 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.955421 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.955645 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.955738 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.955965 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.956049 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.956276 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.956437 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.956609 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.956739 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.956915 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.957052 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.957227 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.957359 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.957554 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.957669 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.958103 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.958197 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.958288 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.958369 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.958514 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.958609 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.958838 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.958925 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.959146 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.959300 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.959467 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.959663 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.959888 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.959974 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.960203 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.960290 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.960527 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.960616 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.960836 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.960945 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.961148 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.961308 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.961504 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.961597 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.961776 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.961871 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.962101 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.962265 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.962378 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.962491 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.962700 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.962799 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.963039 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.963128 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.963365 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.963451 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.963735 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.963940 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.964031 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.964099 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.964342 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.964453 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.964707 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.964804 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.965016 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.965101 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.965341 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.965425 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.965663 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.965750 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.965989 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.966111 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.966310 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.966396 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.966612 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.966719 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.966927 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.967043 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.967240 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.967357 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.967566 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.967682 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.967889 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.968009 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.968202 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.968319 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.968543 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.968654 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.968851 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.968968 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.969173 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.969280 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.969492 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.969587 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.969807 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.969893 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.970128 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.970213 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.970463 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.970555 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.970772 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.970885 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.971081 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.971168 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.971386 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.971480 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.971691 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.971777 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.972013 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.972105 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.972318 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.972431 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.972679 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.972775 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.972987 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.973075 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.973294 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.973388 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.973618 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.973709 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.973923 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.974014 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.974238 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.974398 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.974549 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.974641 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.974855 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.974949 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.975158 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.975250 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.975461 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.975544 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.975778 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.975863 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.976083 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.976169 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.976446 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.976537 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.976739 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.976823 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.977058 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.977146 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.977373 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.977463 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.977672 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.977756 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.977993 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.978079 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.978304 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.978390 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.979143 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.979244 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.979446 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.979533 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.979751 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.979843 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.980066 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.980157 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.980378 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.980488 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.980704 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.980789 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.981011 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.981121 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.981315 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.981408 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.981630 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.981736 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.981929 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.982025 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.982234 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.982319 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.982537 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.982629 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.982861 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.982959 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.983165 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.983252 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.983475 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.983559 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.983782 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.983875 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.984083 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.984167 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.984383 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.984489 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.984709 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.984796 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.985014 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.985107 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.985323 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.985407 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.985624 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.985711 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.985927 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.986012 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.986230 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.986315 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.986551 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.986638 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.986853 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.986937 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.987172 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.987264 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.987482 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.987569 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.987784 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.987868 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.988087 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.988181 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.988389 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.988538 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.988732 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.988932 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.989045 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.989356 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.989486 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.989668 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.989903 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.990015 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.990231 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.990358 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.990558 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.990675 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.991004 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.991366 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.991695 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.992014 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.992331 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.992527 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.992676 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.992869 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.992994 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.993194 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.993312 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.993516 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.993636 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.993838 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.993954 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.994212 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.994352 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.994541 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.994627 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.994860 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.994959 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.995179 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.995269 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.995498 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.995781 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.995873 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.996110 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.996197 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.996471 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.996563 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.996766 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.996869 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.997082 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.997168 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.997396 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.997487 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.997710 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.997804 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.998025 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.998101 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.998337 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.998413 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.998739 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.998839 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.998960 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.999036 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.999287 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.999362 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.999673 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.999759 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:42.999929 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.000004 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.000247 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.000548 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.000653 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.000810 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.000897 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.000974 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.001199 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.001285 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.001512 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.001604 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.001828 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.001915 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.002142 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.002240 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.002504 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.002603 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.002764 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.002859 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.003079 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.003177 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.003394 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.003479 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.003710 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.003795 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.004023 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.004110 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.004334 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.004496 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.004674 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.004771 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.004985 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.005213 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.005298 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.005537 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.005622 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.005874 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.005970 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.006202 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.006295 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.006527 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.006618 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.006844 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.006930 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.007157 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.007233 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.007471 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.007546 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.007782 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.007857 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.008090 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.008307 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.008420 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.008649 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.008737 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.008981 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.009056 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.009367 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.009465 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.009627 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.009724 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.010455 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.010540 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.010772 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.010858 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.011081 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.011179 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.011391 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.011617 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.011710 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.011968 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.012062 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.012287 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.012374 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.012619 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.012745 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.012944 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.013098 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.013339 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.013706 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.013902 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.014221 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.014318 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.014551 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.014646 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.015174 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.015406 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.015713 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.015802 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.016111 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.016202 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.016337 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.016524 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.016673 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.016773 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.016984 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.017070 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.017301 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.017396 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.017616 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.017711 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.017929 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.018015 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.018246 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.018331 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.018553 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.018648 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.018872 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.018947 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.019176 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.019261 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.019477 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.019569 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.019781 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.019873 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.020089 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.020173 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.020393 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.020511 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.020720 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.020807 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.021020 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.021359 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.021575 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.021660 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.021889 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.021975 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.022189 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.022276 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.022493 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.022579 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.022801 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.022919 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.023098 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.023197 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.023401 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.023505 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.023706 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.023792 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.024006 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.024091 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.024317 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.024447 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.024644 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.024752 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.024949 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.025045 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.025246 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.025333 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.026115 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.026220 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.026422 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.026528 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.026733 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.026819 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.027036 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.027129 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.027359 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.027453 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.027665 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.027751 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.027967 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.028257 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.028344 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.028614 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.028716 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.028931 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.029017 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.029244 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.029340 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.029552 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.029641 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.029896 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.029982 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.030213 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.030306 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.030520 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.030761 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.030848 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.031101 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.031194 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.031444 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.031530 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.031758 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.031843 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.032074 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.032160 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.032389 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.032532 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.032724 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.032873 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.033043 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.033163 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.033360 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.033467 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.033672 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.033758 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.033981 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.034075 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.034294 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.034380 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.034605 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.034699 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.034919 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.035076 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.035231 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.035325 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.035541 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.035643 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.035848 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.035948 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.036155 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.036239 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.036487 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.036567 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.036807 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.036928 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.037133 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.037207 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.037446 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.037520 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.037759 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.037842 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.038064 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.038190 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.038375 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.038577 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.038673 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.038827 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.038976 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.039150 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.039290 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.039462 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.039689 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.039788 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.039934 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.040092 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.040299 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.040460 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.040674 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.040773 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.041014 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.041111 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.041330 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.041426 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.041653 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.041741 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.041967 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.042052 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.042290 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.042384 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.042611 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.042749 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.042921 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.043006 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.043244 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.043333 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.043551 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.043626 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.043879 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.043963 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.044196 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.044289 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.044543 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.044630 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.044854 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.044930 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.045164 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.045250 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.045469 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.045556 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.045773 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.045907 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.046085 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.046173 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.046402 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.046486 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.046714 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.046812 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.047031 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.047115 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.047340 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.047434 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.047648 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.047744 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.047955 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.048049 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.048263 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.048347 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.048600 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.048701 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.048912 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.048998 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.049225 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.049310 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.049550 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.049643 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.049856 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.049943 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.050163 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.050255 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.050475 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.050568 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.050788 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.050863 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.051099 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.051175 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.051409 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.051485 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.051733 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.051807 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.052042 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.052124 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.052346 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.052523 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.052711 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.052786 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.053027 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.053119 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.053348 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.053447 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.053660 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.053752 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.053967 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.054060 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.054295 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.054382 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.054604 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.054690 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.054920 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.055028 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.055230 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.055328 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.055539 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.055625 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.055853 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.055981 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.056168 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.056264 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.056460 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 18:16:43.056550 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.056858 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.057211 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.057537 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.057883 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.058195 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.058538 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.058864 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:16:43.059105 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 18:16:43.080281 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG oslo_db.sqlalchemy.engines [None req-05ab3b5c-1a6b-4436-a5c4-39e98a905e1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 18:16:43.082665 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG oslo_db.sqlalchemy.engines [None req-925a2907-4f26-4967-8f84-49b4809eb786 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94140) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 18:16:43.256711 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.context [None req-05ab3b5c-1a6b-4436-a5c4-39e98a905e1f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),795c300a-6d2e-4a0e-badc-5da7a18d8918(cell1) {{(pid=94141) load_cells /opt/stack/nova/nova/context.py:464}} Oct 12 18:16:43.257172 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.context [None req-925a2907-4f26-4967-8f84-49b4809eb786 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),795c300a-6d2e-4a0e-badc-5da7a18d8918(cell1) {{(pid=94140) load_cells /opt/stack/nova/nova/context.py:464}} Oct 12 18:16:43.261271 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG oslo_concurrency.lockutils [None req-05ab3b5c-1a6b-4436-a5c4-39e98a905e1f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:16:43.261751 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG oslo_concurrency.lockutils [None req-925a2907-4f26-4967-8f84-49b4809eb786 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:16:43.262871 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG oslo_concurrency.lockutils [None req-05ab3b5c-1a6b-4436-a5c4-39e98a905e1f None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:16:43.263322 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG oslo_concurrency.lockutils [None req-925a2907-4f26-4967-8f84-49b4809eb786 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:16:43.263665 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG oslo_concurrency.lockutils [None req-05ab3b5c-1a6b-4436-a5c4-39e98a905e1f None None] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:16:43.264120 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG oslo_concurrency.lockutils [None req-925a2907-4f26-4967-8f84-49b4809eb786 None None] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:16:43.265652 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG oslo_concurrency.lockutils [None req-05ab3b5c-1a6b-4436-a5c4-39e98a905e1f None None] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:16:43.266078 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG oslo_concurrency.lockutils [None req-925a2907-4f26-4967-8f84-49b4809eb786 None None] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:16:43.276359 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG oslo_db.sqlalchemy.engines [None req-05ab3b5c-1a6b-4436-a5c4-39e98a905e1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 18:16:43.278863 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG oslo_db.sqlalchemy.engines [None req-05ab3b5c-1a6b-4436-a5c4-39e98a905e1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 18:16:43.281580 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG oslo_db.sqlalchemy.engines [None req-925a2907-4f26-4967-8f84-49b4809eb786 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94140) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 18:16:43.282476 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG oslo_db.sqlalchemy.engines [None req-925a2907-4f26-4967-8f84-49b4809eb786 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94140) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 18:16:43.543634 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG oslo_db.sqlalchemy.engines [None req-05ab3b5c-1a6b-4436-a5c4-39e98a905e1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 18:16:43.546531 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG oslo_db.sqlalchemy.engines [None req-925a2907-4f26-4967-8f84-49b4809eb786 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94140) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 18:16:43.992458 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: WARNING keystonemiddleware.auth_token [None req-05ab3b5c-1a6b-4436-a5c4-39e98a905e1f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 18:16:43.999000 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: WARNING keystonemiddleware.auth_token [None req-05ab3b5c-1a6b-4436-a5c4-39e98a905e1f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 18:16:44.017895 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: WARNING keystonemiddleware.auth_token [None req-925a2907-4f26-4967-8f84-49b4809eb786 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 18:16:44.024790 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: WARNING keystonemiddleware.auth_token [None req-925a2907-4f26-4967-8f84-49b4809eb786 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 18:16:44.347634 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: WARNING keystonemiddleware.auth_token [None req-05ab3b5c-1a6b-4436-a5c4-39e98a905e1f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 18:16:44.352779 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: WARNING keystonemiddleware.auth_token [None req-05ab3b5c-1a6b-4436-a5c4-39e98a905e1f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 18:16:44.358145 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55681159e9c0 pid: 94141 (default app) Oct 12 18:16:44.360238 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-05ab3b5c-1a6b-4436-a5c4-39e98a905e1f None None] Calling method '>' {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:16:44.361433 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-05ab3b5c-1a6b-4436-a5c4-39e98a905e1f None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001766 Oct 12 18:16:44.361826 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Tue Oct 12 18:16:44 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:16:44.376461 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: WARNING keystonemiddleware.auth_token [None req-925a2907-4f26-4967-8f84-49b4809eb786 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 18:16:44.381691 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: WARNING keystonemiddleware.auth_token [None req-925a2907-4f26-4967-8f84-49b4809eb786 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 18:16:44.387758 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55681159e9c0 pid: 94140 (default app) Oct 12 18:18:12.082813 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-05ab3b5c-1a6b-4436-a5c4-39e98a905e1f None None] Calling method '>' {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:18:12.083804 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-05ab3b5c-1a6b-4436-a5c4-39e98a905e1f None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Oct 12 18:18:12.085130 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 930 bytes} [Tue Oct 12 18:18:12 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:18:12.526292 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-2e7b29ff-2dd1-472d-838d-c057bd5270d2 admin admin] Calling method '>' {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:18:12.556360 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-2e7b29ff-2dd1-472d-838d-c057bd5270d2 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.463386 Oct 12 18:18:12.556360 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 1/3] 10.222.0.18 () {60 vars in 1291 bytes} [Tue Oct 12 18:18:12 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:18:14.948052 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-05ab3b5c-1a6b-4436-a5c4-39e98a905e1f None None] Calling method '>' {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:18:14.949141 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-05ab3b5c-1a6b-4436-a5c4-39e98a905e1f None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Oct 12 18:18:14.949545 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 3/4] 10.222.0.18 () {54 vars in 930 bytes} [Tue Oct 12 18:18:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:18:15.014021 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-917872ca-6d61-46c4-bd4e-19b875265033 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "ram": 256, "disk": 1, "swap": 0, "name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:18:15.032970 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:18:15.032970 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: warnings.warn(msg) Oct 12 18:18:15.186958 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-917872ca-6d61-46c4-bd4e-19b875265033 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.230919 Oct 12 18:18:15.187830 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 2/5] 10.222.0.18 () {64 vars in 1282 bytes} [Tue Oct 12 18:18:14 2021] POST /compute/v2.1/flavors => generated 407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:18:15.410581 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-d6e69e3a-7290-4b8d-88c4-2f5856a20d61 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:18:15.413865 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:18:15.413865 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: warnings.warn(msg) Oct 12 18:18:15.558819 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-d6e69e3a-7290-4b8d-88c4-2f5856a20d61 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.361239 Oct 12 18:18:15.559721 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 4/6] 10.222.0.18 () {64 vars in 1335 bytes} [Tue Oct 12 18:18:15 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:18:17.936998 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-917872ca-6d61-46c4-bd4e-19b875265033 admin admin] Calling method '>' {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:18:17.938216 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-917872ca-6d61-46c4-bd4e-19b875265033 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001886 Oct 12 18:18:17.938722 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 3/7] 10.222.0.18 () {54 vars in 930 bytes} [Tue Oct 12 18:18:17 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:18:18.061839 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-6f953c5a-29e3-45cb-9077-616c8493313c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 5, "name": "ds512M", "vcpus": 1, "os-flavor-access:is_public": true, "id": "d1", "ram": 512}} {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:18:18.080329 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:18:18.080329 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: warnings.warn(msg) Oct 12 18:18:18.245885 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-6f953c5a-29e3-45cb-9077-616c8493313c admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.299818 Oct 12 18:18:18.250506 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 5/8] 10.222.0.18 () {64 vars in 1282 bytes} [Tue Oct 12 18:18:17 2021] POST /compute/v2.1/flavors => generated 404 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:18:18.262393 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-3430880c-258e-4208-8ad3-c14813fd7659 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:18:18.264070 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:18:18.264070 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: warnings.warn(msg) Oct 12 18:18:18.400356 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-3430880c-258e-4208-8ad3-c14813fd7659 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.141868 Oct 12 18:18:18.401255 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 4/9] 10.222.0.18 () {64 vars in 1335 bytes} [Tue Oct 12 18:18:18 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:18:20.809822 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-6f953c5a-29e3-45cb-9077-616c8493313c admin admin] Calling method '>' {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:18:20.810932 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-6f953c5a-29e3-45cb-9077-616c8493313c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001631 Oct 12 18:18:20.811483 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 930 bytes} [Tue Oct 12 18:18:20 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:18:20.880356 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-d35a4a6e-f189-4863-a4e4-ee6b1d015d91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "disk": 10, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 1024}} {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:18:21.007560 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-d35a4a6e-f189-4863-a4e4-ee6b1d015d91 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.188959 Oct 12 18:18:21.008370 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 5/11] 10.222.0.18 () {64 vars in 1282 bytes} [Tue Oct 12 18:18:20 2021] POST /compute/v2.1/flavors => generated 404 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:18:21.021108 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-caccc25b-8bf3-4e11-865f-5c28ab7485d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:18:21.118259 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-caccc25b-8bf3-4e11-865f-5c28ab7485d9 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100860 Oct 12 18:18:21.118847 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 7/12] 10.222.0.18 () {64 vars in 1335 bytes} [Tue Oct 12 18:18:21 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:18:23.507608 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-d35a4a6e-f189-4863-a4e4-ee6b1d015d91 admin admin] Calling method '>' {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:18:23.509006 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-d35a4a6e-f189-4863-a4e4-ee6b1d015d91 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001907 Oct 12 18:18:23.509939 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 6/13] 10.222.0.18 () {54 vars in 930 bytes} [Tue Oct 12 18:18:23 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:18:23.573321 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-4db85dca-18eb-41d6-b4a1-7408ac44540e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "ds2G", "os-flavor-access:is_public": true, "disk": 10, "vcpus": 2}} {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:18:23.720126 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-4db85dca-18eb-41d6-b4a1-7408ac44540e admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.202678 Oct 12 18:18:23.720644 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 8/14] 10.222.0.18 () {64 vars in 1282 bytes} [Tue Oct 12 18:18:23 2021] POST /compute/v2.1/flavors => generated 404 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:18:23.734097 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-f70e18db-1fb0-4e88-a92b-20c38f949338 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:18:23.820289 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-f70e18db-1fb0-4e88-a92b-20c38f949338 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090013 Oct 12 18:18:23.820938 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 7/15] 10.222.0.18 () {64 vars in 1335 bytes} [Tue Oct 12 18:18:23 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:18:26.212681 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-4db85dca-18eb-41d6-b4a1-7408ac44540e admin admin] Calling method '>' {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:18:26.214451 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-4db85dca-18eb-41d6-b4a1-7408ac44540e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002239 Oct 12 18:18:26.215323 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 9/16] 10.222.0.18 () {54 vars in 930 bytes} [Tue Oct 12 18:18:26 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:18:26.282184 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-792481bc-3a69-4625-9620-23991a4114b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "swap": 0, "name": "ds4G", "id": "d4", "vcpus": 4, "disk": 20}} {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:18:26.461755 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-792481bc-3a69-4625-9620-23991a4114b9 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.239754 Oct 12 18:18:26.462301 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 8/17] 10.222.0.18 () {64 vars in 1282 bytes} [Tue Oct 12 18:18:26 2021] POST /compute/v2.1/flavors => generated 404 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:18:26.475408 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-935512e1-7148-4d85-9a33-df39a21b53d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:18:26.596611 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-935512e1-7148-4d85-9a33-df39a21b53d0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125252 Oct 12 18:18:26.597274 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 10/18] 10.222.0.18 () {64 vars in 1335 bytes} [Tue Oct 12 18:18:26 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:18:29.166929 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-792481bc-3a69-4625-9620-23991a4114b9 admin admin] Calling method '>' {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:18:29.168080 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-792481bc-3a69-4625-9620-23991a4114b9 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001588 Oct 12 18:18:29.168608 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 9/19] 10.222.0.18 () {54 vars in 930 bytes} [Tue Oct 12 18:18:29 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:18:29.228725 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-5cd1227d-600a-4422-8469-9d85485d2a21 admin admin] Calling method '>' {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:18:29.252934 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-5cd1227d-600a-4422-8469-9d85485d2a21 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077428 Oct 12 18:18:29.253493 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 11/20] 10.222.0.18 () {60 vars in 1291 bytes} [Tue Oct 12 18:18:29 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:18:31.580452 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-792481bc-3a69-4625-9620-23991a4114b9 admin admin] Calling method '>' {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:18:31.581630 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-792481bc-3a69-4625-9620-23991a4114b9 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001640 Oct 12 18:18:31.582065 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 10/21] 10.222.0.18 () {54 vars in 930 bytes} [Tue Oct 12 18:18:31 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:18:31.649118 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-3e327778-5a9c-4d21-8d97-b8ec9a0f4616 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 512, "id": "1", "name": "m1.tiny"}} {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:18:31.752870 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-3e327778-5a9c-4d21-8d97-b8ec9a0f4616 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.161675 Oct 12 18:18:31.753439 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 12/22] 10.222.0.18 () {64 vars in 1282 bytes} [Tue Oct 12 18:18:31 2021] POST /compute/v2.1/flavors => generated 402 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:18:31.772310 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-7cf0995e-3c9d-4f98-92ea-9d6e0b31aecd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:18:31.909834 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-7cf0995e-3c9d-4f98-92ea-9d6e0b31aecd admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.144675 Oct 12 18:18:31.910918 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 11/23] 10.222.0.18 () {64 vars in 1332 bytes} [Tue Oct 12 18:18:31 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:18:34.667995 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-3e327778-5a9c-4d21-8d97-b8ec9a0f4616 admin admin] Calling method '>' {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:18:34.669038 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-3e327778-5a9c-4d21-8d97-b8ec9a0f4616 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Oct 12 18:18:34.669455 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 930 bytes} [Tue Oct 12 18:18:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:18:34.728346 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-3f7f8075-1162-4cd3-89c6-e58fc21fb02f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 2048, "id": "2", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:18:34.903677 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-3f7f8075-1162-4cd3-89c6-e58fc21fb02f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.227711 Oct 12 18:18:34.904149 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 12/25] 10.222.0.18 () {64 vars in 1282 bytes} [Tue Oct 12 18:18:34 2021] POST /compute/v2.1/flavors => generated 405 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:18:34.917303 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-5493cb89-7b81-45bf-af40-d8b146a0fa00 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:18:35.098496 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-5493cb89-7b81-45bf-af40-d8b146a0fa00 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.185405 Oct 12 18:18:35.099089 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 14/26] 10.222.0.18 () {64 vars in 1332 bytes} [Tue Oct 12 18:18:34 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:18:37.440602 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-3f7f8075-1162-4cd3-89c6-e58fc21fb02f admin admin] Calling method '>' {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:18:37.441540 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-3f7f8075-1162-4cd3-89c6-e58fc21fb02f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Oct 12 18:18:37.441947 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 13/27] 10.222.0.18 () {54 vars in 930 bytes} [Tue Oct 12 18:18:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:18:37.498858 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-e30e381f-5509-472f-9a9c-a830c0fe0f56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.medium", "id": "3", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:18:37.594046 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-e30e381f-5509-472f-9a9c-a830c0fe0f56 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.145581 Oct 12 18:18:37.594593 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 15/28] 10.222.0.18 () {64 vars in 1282 bytes} [Tue Oct 12 18:18:37 2021] POST /compute/v2.1/flavors => generated 406 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:18:37.607471 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-a1500a00-ec3e-4c9c-a488-d7518abe88ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:18:37.758604 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-a1500a00-ec3e-4c9c-a488-d7518abe88ed admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.154186 Oct 12 18:18:37.759462 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 14/29] 10.222.0.18 () {64 vars in 1332 bytes} [Tue Oct 12 18:18:37 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:18:40.106557 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-e30e381f-5509-472f-9a9c-a830c0fe0f56 admin admin] Calling method '>' {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:18:40.107169 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-e30e381f-5509-472f-9a9c-a830c0fe0f56 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 12 18:18:40.123787 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 16/30] 10.222.0.18 () {54 vars in 930 bytes} [Tue Oct 12 18:18:40 2021] GET /compute/v2.1 => generated 388 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:18:40.190642 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-6240e4ca-a59f-4056-bf8a-5a06ef5c6026 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "vcpus": 4, "rxtx_factor": 1.0, "swap": 0, "ram": 8192, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "id": "4"}} {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:18:41.051298 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-6240e4ca-a59f-4056-bf8a-5a06ef5c6026 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.936450 Oct 12 18:18:41.053103 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 15/31] 10.222.0.18 () {64 vars in 1282 bytes} [Tue Oct 12 18:18:40 2021] POST /compute/v2.1/flavors => generated 405 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:18:41.067232 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-ca78687b-6a36-49d9-a322-4c49bed27c2c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:18:41.180767 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-ca78687b-6a36-49d9-a322-4c49bed27c2c admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117028 Oct 12 18:18:41.181788 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 17/32] 10.222.0.18 () {64 vars in 1332 bytes} [Tue Oct 12 18:18:41 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:18:43.540936 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-6240e4ca-a59f-4056-bf8a-5a06ef5c6026 admin admin] Calling method '>' {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:18:43.541955 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-6240e4ca-a59f-4056-bf8a-5a06ef5c6026 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Oct 12 18:18:43.542360 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 16/33] 10.222.0.18 () {54 vars in 930 bytes} [Tue Oct 12 18:18:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:18:43.603828 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-bc1f6257-4cc0-46f6-b622-92c557159e0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "rxtx_factor": 1.0, "ram": 16384, "swap": 0, "os-flavor-access:is_public": true, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "id": "5"}} {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:18:43.695590 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-bc1f6257-4cc0-46f6-b622-92c557159e0a admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.146780 Oct 12 18:18:43.698158 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 18/34] 10.222.0.18 () {64 vars in 1282 bytes} [Tue Oct 12 18:18:43 2021] POST /compute/v2.1/flavors => generated 408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:18:43.712430 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-231b5a04-e114-4eb0-9841-c48010a90320 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:18:43.826498 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-231b5a04-e114-4eb0-9841-c48010a90320 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118266 Oct 12 18:18:43.827213 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 17/35] 10.222.0.18 () {64 vars in 1332 bytes} [Tue Oct 12 18:18:43 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:19:23.241239 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-bc1f6257-4cc0-46f6-b622-92c557159e0a admin admin] Calling method '>' {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:19:23.242281 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-bc1f6257-4cc0-46f6-b622-92c557159e0a admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Oct 12 18:19:23.242702 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 19/36] 10.222.0.18 () {54 vars in 930 bytes} [Tue Oct 12 18:19:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:19:23.302390 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-9bba1217-c3d5-452c-8e33-0c975f34c8c1 admin admin] Calling method '>' {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:19:23.323104 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-9bba1217-c3d5-452c-8e33-0c975f34c8c1 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073314 Oct 12 18:19:23.323648 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 18/37] 10.222.0.18 () {60 vars in 1291 bytes} [Tue Oct 12 18:19:23 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:19:24.863005 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-bc1f6257-4cc0-46f6-b622-92c557159e0a admin admin] Calling method '>' {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:19:24.864004 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-bc1f6257-4cc0-46f6-b622-92c557159e0a admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 12 18:19:24.864427 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 20/38] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Oct 12 18:19:24 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:19:25.056003 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-983e466f-7ea0-44ae-93a4-f249dfe52611 admin admin] Calling method '>' {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:19:25.061523 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.wsgi [None req-983e466f-7ea0-44ae-93a4-f249dfe52611 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 12 18:19:25.062083 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-983e466f-7ea0-44ae-93a4-f249dfe52611 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=94140) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:19:25.062885 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-983e466f-7ea0-44ae-93a4-f249dfe52611 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060129 Oct 12 18:19:25.063402 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 19/39] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Oct 12 18:19:25 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 18:19:25.073708 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-0f26f9ca-c326-42f9-9722-e36518ed348a admin admin] Calling method '>' {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:19:25.096035 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-0f26f9ca-c326-42f9-9722-e36518ed348a admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025795 Oct 12 18:19:25.096619 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 21/40] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Oct 12 18:19:25 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:19:25.107022 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-baa10811-bbc6-4ea8-8557-0b34b38e74b3 admin admin] Calling method '>' {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:19:25.129130 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-baa10811-bbc6-4ea8-8557-0b34b38e74b3 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025565 Oct 12 18:19:25.129688 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 20/41] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Oct 12 18:19:25 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:19:25.139907 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-60f0dc09-8174-434d-8de6-f3e95c15674d admin admin] Calling method '>' {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:19:25.145435 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.wsgi [None req-60f0dc09-8174-434d-8de6-f3e95c15674d admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 12 18:19:25.146005 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-60f0dc09-8174-434d-8de6-f3e95c15674d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=94141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:19:25.147067 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-60f0dc09-8174-434d-8de6-f3e95c15674d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010489 Oct 12 18:19:25.147589 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 22/42] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Oct 12 18:19:25 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 18:19:26.583086 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-baa10811-bbc6-4ea8-8557-0b34b38e74b3 admin admin] Calling method '>' {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:19:26.584099 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-baa10811-bbc6-4ea8-8557-0b34b38e74b3 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Oct 12 18:19:26.584525 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 21/43] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Oct 12 18:19:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:19:26.778142 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-70752963-010f-4c59-b4dd-b7ebbf29fb3f admin admin] Calling method '>' {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:19:26.784359 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.wsgi [None req-70752963-010f-4c59-b4dd-b7ebbf29fb3f admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 12 18:19:26.784964 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-70752963-010f-4c59-b4dd-b7ebbf29fb3f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=94141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:19:26.785775 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-70752963-010f-4c59-b4dd-b7ebbf29fb3f admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058965 Oct 12 18:19:26.786305 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 23/44] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Oct 12 18:19:26 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 18:19:26.796214 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-5ef1ec45-771a-4f6c-8e46-5b35033c0257 admin admin] Calling method '>' {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:19:26.810223 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-5ef1ec45-771a-4f6c-8e46-5b35033c0257 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017606 Oct 12 18:19:26.810787 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 22/45] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Oct 12 18:19:26 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:19:26.821606 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-d8931e9d-3a85-4ce5-91d0-50ac8c841f71 admin admin] Calling method '>' {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:19:26.835151 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-d8931e9d-3a85-4ce5-91d0-50ac8c841f71 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016936 Oct 12 18:19:26.839937 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Oct 12 18:19:26 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:19:26.845761 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-3090d3fc-395b-4be8-8fb9-2984071ff018 admin admin] Calling method '>' {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:19:26.851542 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.wsgi [None req-3090d3fc-395b-4be8-8fb9-2984071ff018 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 12 18:19:26.852099 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-3090d3fc-395b-4be8-8fb9-2984071ff018 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=94140) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:19:26.853040 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-3090d3fc-395b-4be8-8fb9-2984071ff018 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010832 Oct 12 18:19:26.853638 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 23/47] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Oct 12 18:19:26 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 18:19:28.289158 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-d8931e9d-3a85-4ce5-91d0-50ac8c841f71 admin admin] Calling method '>' {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:19:28.290819 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-d8931e9d-3a85-4ce5-91d0-50ac8c841f71 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002350 Oct 12 18:19:28.291480 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 25/48] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Oct 12 18:19:28 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:19:28.494813 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-a130591e-e630-4622-9c16-15a1fbc8706f admin admin] Calling method '>' {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:19:28.500792 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.wsgi [None req-a130591e-e630-4622-9c16-15a1fbc8706f admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 12 18:19:28.501289 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-a130591e-e630-4622-9c16-15a1fbc8706f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=94140) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:19:28.502099 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-a130591e-e630-4622-9c16-15a1fbc8706f admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060490 Oct 12 18:19:28.502615 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 24/49] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Oct 12 18:19:28 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 18:19:28.512350 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-9d59fc4b-25d1-4985-b3e5-35a06d87b542 admin admin] Calling method '>' {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:19:28.526008 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-9d59fc4b-25d1-4985-b3e5-35a06d87b542 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017094 Oct 12 18:19:28.526619 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 26/50] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Oct 12 18:19:28 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:19:28.537453 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-0294bc19-17fa-413a-ac0e-01d89fccf047 admin admin] Calling method '>' {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:19:28.551678 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-0294bc19-17fa-413a-ac0e-01d89fccf047 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018364 Oct 12 18:19:28.552226 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 25/51] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Oct 12 18:19:28 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:19:28.562357 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-51a9a07f-6e96-4cd5-aaad-2c6598bd3453 admin admin] Calling method '>' {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:19:28.567642 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.wsgi [None req-51a9a07f-6e96-4cd5-aaad-2c6598bd3453 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 12 18:19:28.568206 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-51a9a07f-6e96-4cd5-aaad-2c6598bd3453 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=94141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:19:28.569041 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-51a9a07f-6e96-4cd5-aaad-2c6598bd3453 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010358 Oct 12 18:19:28.569562 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 27/52] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Oct 12 18:19:28 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 18:19:29.997667 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-0294bc19-17fa-413a-ac0e-01d89fccf047 admin admin] Calling method '>' {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:19:29.998686 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-0294bc19-17fa-413a-ac0e-01d89fccf047 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 12 18:19:29.999086 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Oct 12 18:19:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:19:30.197755 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-7c2a0307-9e08-4698-aa0c-015af2f95a34 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:19:30.278354 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-7c2a0307-9e08-4698-aa0c-015af2f95a34 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.137908 Oct 12 18:19:30.278899 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 28/54] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Oct 12 18:19:30 2021] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:19:31.709260 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-0294bc19-17fa-413a-ac0e-01d89fccf047 admin admin] Calling method '>' {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:19:31.710269 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-0294bc19-17fa-413a-ac0e-01d89fccf047 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Oct 12 18:19:31.710665 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Oct 12 18:19:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:19:31.913307 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-0f690f58-b0d3-4784-be01-59a727aeda55 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:19:32.060169 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-0f690f58-b0d3-4784-be01-59a727aeda55 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.208783 Oct 12 18:19:32.060754 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 29/56] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Oct 12 18:19:31 2021] POST /compute/v2.1/flavors => generated 405 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:19:33.503094 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-0294bc19-17fa-413a-ac0e-01d89fccf047 admin admin] Calling method '>' {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:19:33.504104 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-0294bc19-17fa-413a-ac0e-01d89fccf047 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 12 18:19:33.504526 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 28/57] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Oct 12 18:19:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:19:33.700003 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-270c2457-3619-4418-a283-9a9c010a38d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:19:33.787405 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-270c2457-3619-4418-a283-9a9c010a38d4 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.141324 Oct 12 18:19:33.787956 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 30/58] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Oct 12 18:19:33 2021] POST /compute/v2.1/flavors => generated 407 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:19:35.227068 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-0294bc19-17fa-413a-ac0e-01d89fccf047 admin admin] Calling method '>' {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:19:35.228165 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-0294bc19-17fa-413a-ac0e-01d89fccf047 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Oct 12 18:19:35.228609 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 29/59] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Oct 12 18:19:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:19:35.419505 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-1e5c4e99-b748-4393-a88f-7d9c6b7a1176 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:19:35.507593 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-1e5c4e99-b748-4393-a88f-7d9c6b7a1176 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.140932 Oct 12 18:19:35.508059 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 31/60] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Oct 12 18:19:35 2021] POST /compute/v2.1/flavors => generated 409 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:19:36.931415 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-0294bc19-17fa-413a-ac0e-01d89fccf047 admin admin] Calling method '>' {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:19:36.932473 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-0294bc19-17fa-413a-ac0e-01d89fccf047 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Oct 12 18:19:36.932875 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 30/61] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Oct 12 18:19:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:19:37.131744 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-8d8c5429-e93d-48fc-b3f9-8af9d646f210 admin admin] Calling method '>' {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:19:37.152661 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-8d8c5429-e93d-48fc-b3f9-8af9d646f210 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.078058 Oct 12 18:19:37.152661 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 32/62] 10.222.0.18 () {60 vars in 1202 bytes} [Tue Oct 12 18:19:37 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:20:25.446283 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-0294bc19-17fa-413a-ac0e-01d89fccf047 admin admin] Calling method '>' {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:20:25.447298 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-0294bc19-17fa-413a-ac0e-01d89fccf047 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Oct 12 18:20:25.447700 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 31/63] 10.222.0.18 () {54 vars in 930 bytes} [Tue Oct 12 18:20:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:20:25.507439 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-89b21112-050c-48e6-b0d6-e01f0f5e10db admin admin] Calling method '>' {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:20:25.527334 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-89b21112-050c-48e6-b0d6-e01f0f5e10db admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072062 Oct 12 18:20:25.527880 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 33/64] 10.222.0.18 () {60 vars in 1291 bytes} [Tue Oct 12 18:20:25 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:20:25.550293 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-91a10a0a-60c8-4548-980f-464db77ffc62 admin admin] Calling method '>' {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:20:25.557945 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-91a10a0a-60c8-4548-980f-464db77ffc62 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011347 Oct 12 18:20:25.558486 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 32/65] 10.222.0.18 () {60 vars in 1282 bytes} [Tue Oct 12 18:20:25 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:20:25.571312 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-6c0cef56-f7fb-4d14-8f54-4d28374f136c admin admin] Calling method '>' {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:20:25.579610 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-6c0cef56-f7fb-4d14-8f54-4d28374f136c admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011847 Oct 12 18:20:25.580258 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 34/66] 10.222.0.18 () {60 vars in 1285 bytes} [Tue Oct 12 18:20:25 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:20:25.592452 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-5fd0b3f3-3d33-4f1e-97ae-e1f91e8cb790 admin admin] Calling method '>' {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:20:25.600787 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-5fd0b3f3-3d33-4f1e-97ae-e1f91e8cb790 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011958 Oct 12 18:20:25.601331 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 33/67] 10.222.0.18 () {60 vars in 1285 bytes} [Tue Oct 12 18:20:25 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:20:25.615135 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-197b2519-e9cf-48c3-a49a-2009a5969ede admin admin] Calling method '>' {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:20:25.623045 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-197b2519-e9cf-48c3-a49a-2009a5969ede admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011737 Oct 12 18:20:25.623603 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 35/68] 10.222.0.18 () {60 vars in 1282 bytes} [Tue Oct 12 18:20:25 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:22:05.902149 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-36304565-3466-4491-9c39-d9623219f87c tempest-verify_tempest_config-506757309 tempest-verify_tempest_config-506757309-project] Calling method '>' {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:22:05.904141 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-36304565-3466-4491-9c39-d9623219f87c tempest-verify_tempest_config-506757309 tempest-verify_tempest_config-506757309-project] 10.222.0.18 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.105003 Oct 12 18:22:05.904702 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 34/69] 10.222.0.18 () {58 vars in 1133 bytes} [Tue Oct 12 18:22:05 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:23:35.325872 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-197b2519-e9cf-48c3-a49a-2009a5969ede admin admin] Calling method '>' {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:23:35.326920 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-197b2519-e9cf-48c3-a49a-2009a5969ede admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Oct 12 18:23:35.327331 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 36/70] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Oct 12 18:23:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:23:35.587293 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-65eedaf8-8b39-459b-aec2-947fb27f2c7b admin admin] Calling method '>' {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:23:35.588685 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:23:35.588685 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: warnings.warn(msg) Oct 12 18:23:35.590410 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG oslo_concurrency.lockutils [None req-65eedaf8-8b39-459b-aec2-947fb27f2c7b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:23:35.590907 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG oslo_concurrency.lockutils [None req-65eedaf8-8b39-459b-aec2-947fb27f2c7b admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:23:35.591688 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG oslo_concurrency.lockutils [None req-65eedaf8-8b39-459b-aec2-947fb27f2c7b admin admin] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:23:35.592103 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG oslo_concurrency.lockutils [None req-65eedaf8-8b39-459b-aec2-947fb27f2c7b admin admin] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:23:35.626488 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-65eedaf8-8b39-459b-aec2-947fb27f2c7b admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.155946 Oct 12 18:23:35.627501 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 35/71] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Oct 12 18:23:35 2021] GET /compute/v2.1/os-services => generated 791 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:23:37.069245 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-197b2519-e9cf-48c3-a49a-2009a5969ede admin admin] Calling method '>' {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:23:37.070239 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-197b2519-e9cf-48c3-a49a-2009a5969ede admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 12 18:23:37.070627 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 37/72] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Oct 12 18:23:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 18:23:37.263592 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-78079a9e-2c11-4e62-ab77-d8d0d4d25ba3 admin admin] Calling method '>' {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:23:37.264783 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:23:37.264783 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: warnings.warn(msg) Oct 12 18:23:37.266273 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG oslo_concurrency.lockutils [None req-78079a9e-2c11-4e62-ab77-d8d0d4d25ba3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:23:37.266703 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG oslo_concurrency.lockutils [None req-78079a9e-2c11-4e62-ab77-d8d0d4d25ba3 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:23:37.267524 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG oslo_concurrency.lockutils [None req-78079a9e-2c11-4e62-ab77-d8d0d4d25ba3 admin admin] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:23:37.267923 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG oslo_concurrency.lockutils [None req-78079a9e-2c11-4e62-ab77-d8d0d4d25ba3 admin admin] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:23:37.287104 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-78079a9e-2c11-4e62-ab77-d8d0d4d25ba3 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075334 Oct 12 18:23:37.287579 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 36/73] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Oct 12 18:23:37 2021] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:23:49.139973 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-197b2519-e9cf-48c3-a49a-2009a5969ede admin admin] Calling method '>' {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:23:49.141040 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-197b2519-e9cf-48c3-a49a-2009a5969ede admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 12 18:23:49.141442 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 38/74] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Oct 12 18:23:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:23:49.337144 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-c11057a1-9d7d-461a-9eba-80ac0818fdc0 admin admin] Calling method '>' {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:23:49.338293 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:23:49.338293 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: warnings.warn(msg) Oct 12 18:23:49.339887 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG oslo_concurrency.lockutils [None req-c11057a1-9d7d-461a-9eba-80ac0818fdc0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:23:49.340320 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG oslo_concurrency.lockutils [None req-c11057a1-9d7d-461a-9eba-80ac0818fdc0 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:23:49.341132 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG oslo_concurrency.lockutils [None req-c11057a1-9d7d-461a-9eba-80ac0818fdc0 admin admin] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:23:49.341557 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG oslo_concurrency.lockutils [None req-c11057a1-9d7d-461a-9eba-80ac0818fdc0 admin admin] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:23:49.365492 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-c11057a1-9d7d-461a-9eba-80ac0818fdc0 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081955 Oct 12 18:23:49.365974 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 37/75] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Oct 12 18:23:49 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:23:50.806712 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: DEBUG nova.api.openstack.wsgi [None req-197b2519-e9cf-48c3-a49a-2009a5969ede admin admin] Calling method '>' {{(pid=94141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:23:50.807716 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: INFO nova.api.openstack.requestlog [None req-197b2519-e9cf-48c3-a49a-2009a5969ede admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Oct 12 18:23:50.808114 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: [pid: 94141|app: 0|req: 39/76] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Oct 12 18:23:50 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:23:51.001255 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG nova.api.openstack.wsgi [None req-ce96eebe-dd95-4814-a9d1-8290404b33d6 admin admin] Calling method '>' {{(pid=94140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:23:51.002405 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:23:51.002405 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: warnings.warn(msg) Oct 12 18:23:51.003967 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG oslo_concurrency.lockutils [None req-ce96eebe-dd95-4814-a9d1-8290404b33d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:23:51.004415 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG oslo_concurrency.lockutils [None req-ce96eebe-dd95-4814-a9d1-8290404b33d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:23:51.005350 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG oslo_concurrency.lockutils [None req-ce96eebe-dd95-4814-a9d1-8290404b33d6 admin admin] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:23:51.005771 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: DEBUG oslo_concurrency.lockutils [None req-ce96eebe-dd95-4814-a9d1-8290404b33d6 admin admin] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:23:51.027501 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: INFO nova.api.openstack.requestlog [None req-ce96eebe-dd95-4814-a9d1-8290404b33d6 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079091 Oct 12 18:23:51.028358 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: [pid: 94140|app: 0|req: 38/77] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Oct 12 18:23:50 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:24:49.333871 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: Tue Oct 12 18:24:49 2021 - graceful shutdown triggered... Oct 12 18:24:49.334001 dv-cinder-813227-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 12 18:24:49.335522 dv-cinder-813227-2-iscsi devstack@n-api.service[94140]: Gracefully killing worker 1 (pid: 94140)... Oct 12 18:24:49.335925 dv-cinder-813227-2-iscsi devstack@n-api.service[94141]: Gracefully killing worker 2 (pid: 94141)... Oct 12 18:24:50.335642 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: worker 1 buried after 1 seconds Oct 12 18:24:50.336156 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: worker 2 buried after 1 seconds Oct 12 18:24:50.336156 dv-cinder-813227-2-iscsi devstack@n-api.service[94139]: goodbye to uWSGI. Oct 12 18:24:50.337213 dv-cinder-813227-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 12 18:24:50.337766 dv-cinder-813227-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 12 18:24:50.340615 dv-cinder-813227-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 12 18:24:50.351926 dv-cinder-813227-2-iscsi devstack@n-api.service[109155]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 12 18:24:50.353949 dv-cinder-813227-2-iscsi devstack@n-api.service[109155]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 12 18:24:50 2021] *** Oct 12 18:24:50.353949 dv-cinder-813227-2-iscsi devstack@n-api.service[109155]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 12 18:24:50.353949 dv-cinder-813227-2-iscsi devstack@n-api.service[109155]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 12 18:24:50.353949 dv-cinder-813227-2-iscsi devstack@n-api.service[109155]: nodename: dv-cinder-813227-2-iscsi Oct 12 18:24:50.353949 dv-cinder-813227-2-iscsi devstack@n-api.service[109155]: machine: x86_64 Oct 12 18:24:50.353949 dv-cinder-813227-2-iscsi devstack@n-api.service[109155]: clock source: unix Oct 12 18:24:50.353949 dv-cinder-813227-2-iscsi devstack@n-api.service[109155]: pcre jit disabled Oct 12 18:24:50.353949 dv-cinder-813227-2-iscsi devstack@n-api.service[109155]: detected number of CPU cores: 4 Oct 12 18:24:50.353949 dv-cinder-813227-2-iscsi devstack@n-api.service[109155]: current working directory: / Oct 12 18:24:50.353949 dv-cinder-813227-2-iscsi devstack@n-api.service[109155]: detected binary path: /usr/bin/uwsgi-core Oct 12 18:24:50.353949 dv-cinder-813227-2-iscsi devstack@n-api.service[109155]: your processes number limit is 47680 Oct 12 18:24:50.354778 dv-cinder-813227-2-iscsi devstack@n-api.service[109155]: your memory page size is 4096 bytes Oct 12 18:24:50.354778 dv-cinder-813227-2-iscsi devstack@n-api.service[109155]: detected max file descriptor number: 2048 Oct 12 18:24:50.354778 dv-cinder-813227-2-iscsi devstack@n-api.service[109155]: lock engine: pthread robust mutexes Oct 12 18:24:50.354778 dv-cinder-813227-2-iscsi devstack@n-api.service[109155]: thunder lock: enabled Oct 12 18:24:50.354778 dv-cinder-813227-2-iscsi devstack@n-api.service[109155]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 12 18:24:50.354778 dv-cinder-813227-2-iscsi devstack@n-api.service[109155]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 12 18:24:50.399277 dv-cinder-813227-2-iscsi devstack@n-api.service[109155]: Python main interpreter initialized at 0x55e92f25f9c0 Oct 12 18:24:50.399277 dv-cinder-813227-2-iscsi devstack@n-api.service[109155]: python threads support enabled Oct 12 18:24:50.399277 dv-cinder-813227-2-iscsi devstack@n-api.service[109155]: your server socket listen backlog is limited to 100 connections Oct 12 18:24:50.399277 dv-cinder-813227-2-iscsi devstack@n-api.service[109155]: your mercy for graceful operations on workers is 90 seconds Oct 12 18:24:50.399673 dv-cinder-813227-2-iscsi devstack@n-api.service[109155]: mapped 403077 bytes (393 KB) for 2 cores Oct 12 18:24:50.399673 dv-cinder-813227-2-iscsi devstack@n-api.service[109155]: *** Operational MODE: preforking *** Oct 12 18:24:50.399917 dv-cinder-813227-2-iscsi devstack@n-api.service[109155]: *** uWSGI is running in multiple interpreter mode *** Oct 12 18:24:50.399917 dv-cinder-813227-2-iscsi devstack@n-api.service[109155]: spawned uWSGI master process (pid: 109155) Oct 12 18:24:50.403184 dv-cinder-813227-2-iscsi devstack@n-api.service[109155]: spawned uWSGI worker 1 (pid: 109168, cores: 1) Oct 12 18:24:50.403184 dv-cinder-813227-2-iscsi devstack@n-api.service[109155]: spawned uWSGI worker 2 (pid: 109169, cores: 1) Oct 12 18:24:50.403184 dv-cinder-813227-2-iscsi devstack@n-api.service[109155]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 12 18:24:50.400091 dv-cinder-813227-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 12 18:24:52.232174 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 18:24:52.232174 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: from cryptography.utils import int_from_bytes Oct 12 18:24:52.233267 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 18:24:52.233267 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: from cryptography.utils import int_from_bytes Oct 12 18:24:52.240329 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 18:24:52.240329 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: from cryptography.utils import int_from_bytes Oct 12 18:24:52.240924 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 18:24:52.240924 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: from cryptography.utils import int_from_bytes Oct 12 18:24:54.802249 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 18:24:54.802249 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 18:24:54.802249 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 18:24:54.802249 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 18:24:54.802249 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 18:24:54.802249 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.802249 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.802249 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.803311 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.803311 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.803311 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.803311 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.803311 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.803311 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.803311 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.803311 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.803869 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813227-2-iscsi {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.803869 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.803869 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.803869 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.803869 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.803869 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.803869 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.803869 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.804867 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.805822 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.806162 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.806486 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.806852 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.807176 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.807498 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.807833 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.808157 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.808514 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.808826 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.809243 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813227-2-iscsi {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.809571 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.809887 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.810212 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.810792 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.811109 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.811416 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.811755 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.812078 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.812393 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.812749 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.813025 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 18:24:54.813470 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.813553 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 18:24:54.813631 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.813703 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.813783 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 18:24:54.813998 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.814106 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 18:24:54.814309 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.814415 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 18:24:54.814626 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.814807 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.814962 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.815065 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.815258 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.815378 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.815572 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.815702 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.815859 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.815964 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.816128 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.816302 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.816518 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.816638 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.816803 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.816909 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.817137 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.817262 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.817422 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.817544 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.817634 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.817811 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.818052 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.818152 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813227-2-iscsi {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.818239 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.818410 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.818569 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.818891 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.819243 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.819402 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.819563 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.819715 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.819869 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.820031 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.820180 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.820333 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.820522 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.820668 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.820808 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.820968 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.821143 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.821294 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.821447 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.821600 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.821761 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.822248 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.822441 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.822591 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.822742 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.822885 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.823027 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.823178 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.823178 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.823178 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.823602 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.823757 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.823906 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.824078 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.824231 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813227-2-iscsi {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.824373 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.824565 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.825398 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.825580 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.825740 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.825893 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.825893 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.826165 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.826314 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.826471 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.826627 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.826776 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.826920 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.827069 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.827238 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.827400 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.827544 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.827772 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.827893 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.828127 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.828245 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.828365 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.828824 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.828943 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.830781 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.830943 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.831098 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.831250 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.831250 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.831609 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.831762 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.831762 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.832061 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.832214 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.832214 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.832537 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.832693 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.832693 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.832984 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.833138 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.833138 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.833418 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.833567 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.833777 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.833927 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.834071 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.834222 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.834222 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.834517 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.835193 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.835830 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.835992 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.836144 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.836287 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.836495 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.836661 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.836805 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.837011 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.837153 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.837307 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.837497 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.837683 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.837829 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.837979 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.838207 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.838377 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.838528 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.839069 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.839229 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.839380 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.839532 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.839685 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.839828 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.839991 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.840141 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.840287 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.840517 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.840517 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.840854 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.840854 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.841218 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.841369 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.841512 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.841664 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.841807 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.841966 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.842123 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.842272 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.842424 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.842574 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.842725 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.842867 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.843093 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.843243 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.843391 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.843534 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.843675 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.843831 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.843991 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.844134 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.844286 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.844497 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.844648 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.844814 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.844957 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.845107 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.845257 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.845400 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.846131 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.846299 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.846443 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.846605 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.846759 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.846902 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.847054 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.847207 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.847350 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.847499 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.847649 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.847792 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.847949 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.848100 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.848100 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.848384 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.848605 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.848749 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.849014 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.849365 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.849511 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.849653 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.849796 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.849937 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.850096 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.850251 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.850489 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.851294 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.851460 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.851604 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.851761 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.851904 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.852056 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.852208 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.852360 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.852545 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.852700 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.852843 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.852986 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.853128 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.853271 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.853432 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.853576 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.853718 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.853875 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.854017 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.854168 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.854311 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.854462 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.854611 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.854766 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.854909 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.855059 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.855059 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.855341 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.855491 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.855667 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.856233 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.856393 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.856574 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.856719 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.856871 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.857014 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.857157 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.857299 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.857451 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.857605 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.857758 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.857910 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.858064 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.858208 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.858361 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.858514 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.858657 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.858657 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.858936 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.859196 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.859517 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.859676 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.859830 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.859974 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.860129 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.860277 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.860460 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.860630 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.860785 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.860978 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.861129 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.861272 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.861414 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.861570 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.861720 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.861896 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.862049 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.862220 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 18:24:54.862494 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.862659 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.862814 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.862958 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.863100 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.863243 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.863391 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.863547 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.863690 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.863833 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.863994 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.864138 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.864288 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.864461 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.864619 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.864772 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.864922 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.865065 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.865215 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.865368 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.865511 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.865653 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.865789 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.865894 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.866422 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.866527 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.866628 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.866722 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.866819 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.866904 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.867066 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.867163 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.867257 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.867349 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.867441 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.867525 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.867729 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.867838 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.867926 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.868009 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.868100 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.868184 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.868286 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.868379 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.868478 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.868574 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.868660 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.868743 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.868839 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.868931 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.869023 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.869023 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.869023 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.869295 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.869388 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.869388 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.869388 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.869901 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.869999 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.869999 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.869999 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.869999 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.869999 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.869999 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.870462 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.870559 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.870649 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.870734 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.870734 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.870734 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.870734 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.871039 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.871285 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.871386 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.871639 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.871881 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.871986 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.872247 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.872496 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.872612 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.872880 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.873081 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.873184 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.873480 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.873688 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.873807 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.874123 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.874287 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.874432 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.874741 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.874838 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.875050 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.875375 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.875474 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.875694 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.875993 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.876112 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.876681 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.876766 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.876865 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.877068 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.877165 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.877389 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.877649 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.877740 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.878012 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.878237 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.878329 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.878635 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.878827 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.878954 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.879279 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.879431 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.879615 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.879909 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.880012 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.880219 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.880584 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.880690 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.880934 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.881252 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.881354 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.881586 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.881911 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.882009 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.882257 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.882511 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.882610 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.882911 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.883108 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.883265 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.883561 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.883708 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.883883 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.884199 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.884290 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.884542 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.884863 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.884956 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.885181 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.885464 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.885571 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.885811 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.886058 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.886149 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.886460 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.886787 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.886883 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.887067 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.887237 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.887393 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.887706 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.887798 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.888026 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.888339 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.888473 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.888714 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.888957 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.889103 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.889336 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.889552 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.889657 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.890034 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.890155 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.890276 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.890621 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.890730 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.890961 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.891237 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.891353 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.891551 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.891874 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.892191 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.892288 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.892540 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.892837 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.892937 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.893160 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.893435 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.893526 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.893770 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.894030 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.894122 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.894382 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.894644 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.894742 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.895015 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.895257 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.895355 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.895654 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.895850 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.895963 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.896273 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.896593 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.896859 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.896948 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.897038 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.897768 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.898075 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.898176 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.898382 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.899036 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.899178 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.899281 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.899511 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.899617 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.899922 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.900131 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.900258 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.900549 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.900695 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.900907 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.901196 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.901299 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.901508 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.901708 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.901835 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.902135 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.902234 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.902458 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.902603 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.902775 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.903038 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.903137 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.903397 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.903487 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.903713 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.903900 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.904040 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.904339 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.904457 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.904698 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.911960 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.912062 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.912149 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.912240 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.912326 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.912478 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.912590 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.912677 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.912763 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.912763 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.913554 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.913653 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.913739 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.913823 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.913906 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.913996 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.914088 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.914181 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.914266 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.914350 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.914440 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.914531 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.914623 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.914719 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.914804 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.914893 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.914984 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.915068 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.915151 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.915247 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.915332 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.915422 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.915513 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.915604 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.915700 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.915784 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.915866 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.915949 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.916039 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.916039 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.916205 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.916297 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.916485 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.916576 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.916674 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.917092 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.917092 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.917092 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.917340 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.917433 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.917433 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.917433 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.917433 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.917433 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.917433 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.917433 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.918000 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.918098 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.918098 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.918098 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.918098 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.918396 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.918481 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.918481 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.918481 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.918481 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.918481 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.918862 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.918946 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.919030 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.919638 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.919737 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.919824 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.919908 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.920231 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.920365 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.920561 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.920815 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.920920 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.921240 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.921426 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.921536 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.921740 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.922056 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.922146 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.922366 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.922663 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.922758 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.922975 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.923302 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.923400 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.923616 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.923926 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.924017 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.924233 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.924562 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.924673 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.924888 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.925196 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.925287 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.925518 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.925798 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.925892 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.926127 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.926385 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.926478 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.926734 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.927314 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.927427 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.927528 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.927614 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.927698 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.927939 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.928134 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.928270 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.928640 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.928737 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.928953 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.929264 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.929363 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.929573 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.929885 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.929983 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.930340 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.930509 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.930696 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.931002 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.931118 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.931214 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.931486 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.931714 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.931807 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.932096 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.932451 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.932548 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.932733 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.932886 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.933042 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.933351 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.933450 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.933767 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.933954 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.934264 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.934507 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.934621 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.934894 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.935014 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.935204 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.935472 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.935564 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.935809 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.935986 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.936163 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.936478 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.936589 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.936851 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.936996 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.937170 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.937440 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.937555 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.937805 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.937940 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.938126 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.938402 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.938493 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.938756 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.938910 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.939068 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.939358 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.939457 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.939695 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.939860 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.940017 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.940316 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.940453 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.940664 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.940770 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.941000 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.941101 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.941319 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.941436 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.941638 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.941741 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.941964 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.942081 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.942289 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.942392 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.942615 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.942725 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.942925 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.943043 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.943236 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.943338 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.943549 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.943650 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.943859 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.943969 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.944722 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.944838 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.945038 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.945139 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.945357 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.945529 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.945678 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.945771 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.945995 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.946087 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.946309 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.946410 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.946624 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.946724 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.946937 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.947029 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.947251 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.947360 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.947567 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.947673 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.947877 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.947970 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.948190 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.948294 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.948536 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.948644 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.948851 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.948952 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.949165 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.949265 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.949471 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.949562 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.949788 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.949907 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.950099 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.950201 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.950411 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.950547 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.950728 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.950873 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.951037 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.951190 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.951355 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.951487 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.951678 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.951787 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.952108 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.952265 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.952451 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.952629 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.952778 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.952954 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.953089 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.953281 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.953516 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.953616 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.953836 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.953930 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.954154 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.954247 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.954469 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.954643 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.954811 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.954955 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.955107 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.955283 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.955365 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.955599 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.955910 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.956224 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.956565 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.956743 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.956902 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.957057 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.957225 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.957478 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.957741 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.957901 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.958055 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.958223 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.958395 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.958677 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.958836 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.958836 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.959152 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.959353 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.960361 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.960738 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.960906 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.961116 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.961222 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.961504 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.961653 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.961838 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.961986 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.962223 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.962332 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.962689 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.962844 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.962990 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.963147 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.963300 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.963450 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.963594 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.963737 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.963879 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.964058 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.964204 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.964382 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.964497 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.964748 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.964843 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.965086 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.965179 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.965410 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.965512 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.965735 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.965839 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.966050 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.966152 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.966372 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.966471 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.966684 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.966787 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.967001 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.967102 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.967316 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.967408 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.967629 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.967752 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.967940 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.968052 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.968255 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.968369 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.968728 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.968911 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.969061 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.969155 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.969377 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.969470 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.969692 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.969787 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.970006 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.970098 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.970317 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.970408 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.970709 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.970830 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.970967 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.971090 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.971283 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.971380 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.971577 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.971678 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.971891 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.972008 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.972202 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.972301 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.972529 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.972637 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.972839 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.972931 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.973143 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.973244 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.973465 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.973564 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.973772 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.973863 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.974080 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.974186 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.974387 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.974480 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.974698 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.974791 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.975011 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.975113 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.975341 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.975438 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.975670 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.975769 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.975979 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.976084 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.976284 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.976377 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.976624 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.976776 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.976933 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.977027 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.977240 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.977333 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.977553 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.977654 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.977879 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.977974 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.978199 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.978291 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.978536 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.978661 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.978882 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.978987 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.979218 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.979330 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.979542 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.979645 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.979851 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.979964 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.980167 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.980269 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.980503 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.980617 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.980818 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.980920 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.981127 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.981242 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.981433 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.981541 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.981740 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.981848 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.982046 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.982150 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.982358 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.982472 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.982659 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.982772 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.982962 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.983061 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.983264 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.983369 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.983589 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.983690 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.983900 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.983991 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.984227 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.984326 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.984577 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.984669 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.984888 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.984981 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.985200 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.985302 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.985508 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.985608 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.985821 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.985913 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.986139 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.986232 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.986446 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.986548 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.986766 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.986858 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.987084 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.987177 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.987400 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.987492 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.987707 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.987809 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.988013 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.988106 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.988336 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.988455 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.988698 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.988816 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.989015 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.989116 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.989359 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.989462 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.989678 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.989782 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.989999 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.990100 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.990302 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.990473 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.990614 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.990708 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.990962 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.991075 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.991289 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.991406 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.991614 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.991715 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.991922 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.992179 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.992317 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.992559 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.992931 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.992931 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.993088 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.993168 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.993242 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.993475 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.993654 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.993782 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.993877 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.994093 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.994200 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.994405 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.994507 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.994711 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.994806 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.995026 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.995126 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.995332 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.995435 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.995638 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.995733 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.995948 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.996055 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.996254 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.996354 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.996592 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.996688 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.996904 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.996998 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.997267 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.997370 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.997588 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.997682 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.997908 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.998002 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.998230 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.998329 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.998544 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.998644 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.998861 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.998964 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.999191 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.999296 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.999512 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.999615 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.999834 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:54.999927 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.000154 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.000254 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.000503 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.000620 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.000830 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.000923 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.001151 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.001271 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.001471 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.001590 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.001774 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.001873 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.002090 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.002203 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.002406 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.002505 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.002708 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.002809 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.003013 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.003108 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.003318 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.003420 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.003641 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.003734 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.003945 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.004047 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.004269 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.004363 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.004732 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.004865 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.005045 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.005190 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.005492 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.005587 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.005850 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.005948 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.006184 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.006291 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.006509 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.007165 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.007349 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.007454 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.007671 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.007775 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.008076 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.008184 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.008271 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.008342 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.008618 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.008729 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.008934 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.009069 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.009245 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.009350 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.009579 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.009686 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.009890 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.009986 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.010197 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.010304 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.010503 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.010596 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.010827 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.010921 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.011206 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.011365 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.011488 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.011721 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.011813 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.012044 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.012158 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.012378 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.012586 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.012733 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.012870 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.013057 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.013199 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.013371 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.013526 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.013700 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.013837 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.014015 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.014145 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.014326 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.014459 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.014649 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.014767 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.014965 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.015065 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.015277 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.015371 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.015590 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.015683 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.015906 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.016000 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.016221 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.016314 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.016556 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.016652 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.016876 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.016979 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.017182 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.017273 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.017505 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.017597 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.017809 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.017915 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.018117 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.018209 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.018427 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.018520 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.018745 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.018851 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.019057 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.019169 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.019363 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.019464 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.019666 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.019770 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.019977 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.020069 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.020280 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.020372 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.020610 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.020790 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.020915 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.021017 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.021253 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.021342 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.021554 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.021647 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.021863 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.021954 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.022237 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.022868 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.023063 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.023172 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.023398 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.023509 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.023972 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.024070 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.024327 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.024450 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.024629 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.024731 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.024950 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.025058 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.025276 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.025370 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.025583 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.025714 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.025888 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.025992 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.026199 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.026293 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.026505 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.026608 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.026808 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.027071 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.027167 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.027414 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.027509 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.027714 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.027806 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.028015 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.028109 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.028318 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.028480 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.028665 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.028801 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.028971 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.029121 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.029297 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.029431 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.029609 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.029752 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.029910 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.030071 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.030214 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.030390 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.030517 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.030713 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.030886 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.031031 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.031189 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.031351 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.031524 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.031670 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.031841 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.031986 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.032163 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.032302 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.032515 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.032649 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.032826 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.032998 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.033152 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.033330 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.033472 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.033654 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.033787 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.033976 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.034103 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.034300 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.034409 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.034617 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.034719 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.034934 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.035034 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.035250 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.035345 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.035567 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.035670 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.035889 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.035992 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.036220 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.036313 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.036564 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.036672 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.036875 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.037112 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.037304 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.037442 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.037625 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.037756 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.037997 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.038097 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.038327 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.038422 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.038646 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.038748 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.038975 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.039077 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.039294 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.039401 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.039607 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.039716 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.039921 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.040037 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.040230 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.040337 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.040582 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.040687 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.040933 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.041044 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.041257 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.041348 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.041585 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.041684 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.041898 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.041995 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.042207 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.042298 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.042517 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.042609 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.042827 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.042920 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.043163 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.043278 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.043484 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.043603 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.043790 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.043886 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.044101 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.044194 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.044438 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.044550 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.044751 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.044851 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.045061 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.045161 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.045374 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.045477 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.045686 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.045786 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.045998 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.046092 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.046308 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.046446 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.046616 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.046717 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.046929 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.047023 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.047244 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.047337 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.047560 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.047655 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.047876 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.047969 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.048194 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.048301 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.048537 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.048644 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.048852 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.048955 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.049169 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.049270 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.049497 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.049683 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.049821 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.050000 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.050150 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.050331 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.050469 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.050655 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.050794 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.050979 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.051128 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.051296 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.051444 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.051642 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.051765 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.051969 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.052080 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.052320 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.052453 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.052607 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.052747 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.052919 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.053070 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.053229 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.053416 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.053563 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.053756 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.053891 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.054078 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.054411 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.054768 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.054900 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.055087 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.055182 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.055438 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.055533 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.055747 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.055847 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.056008 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 18:24:55.056287 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.056665 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.057013 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.057349 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.057679 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.058000 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.058309 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.058636 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.058947 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.059256 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.059576 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.059888 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.060195 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.060522 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.060840 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.061149 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.061455 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.061768 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.062074 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.062402 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.062707 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.063012 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.063317 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.063628 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.063936 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.064240 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.064566 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.064872 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.065186 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.065494 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.065803 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.066110 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.066424 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.066729 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.067039 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.067349 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.067671 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.067978 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.068281 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.068617 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.068930 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.069901 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.070233 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.070549 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.070900 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.071221 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.071759 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.072096 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.072502 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.072847 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.073189 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.073500 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.073814 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.074247 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.074581 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.074972 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.075301 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.075613 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.075924 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.076235 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.076572 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.076884 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.077202 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.077515 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.077860 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.078184 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.078503 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.078820 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.079140 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.079452 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.079763 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.079921 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_db.sqlalchemy.engines [None req-64371f0f-bca0-4d51-b491-5b7f2db176bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 18:24:55.080196 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.080385 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.080719 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.081051 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.081363 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.081671 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.082099 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.082421 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.082738 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.083060 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.083371 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.083697 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.084022 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.084334 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.084707 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.085576 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.085910 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.086258 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.086591 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.086916 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.087227 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.087533 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.087837 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.088146 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.088510 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.088829 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.089152 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.089465 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.089786 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.090096 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.090420 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.090742 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.091113 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.091429 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.091762 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.092073 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.092386 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.092723 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.093034 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.093346 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.093656 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.093984 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.094310 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.094615 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.094945 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.095262 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.095583 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.095896 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.096208 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.096559 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.096873 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.097195 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.097508 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.097821 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.098140 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.098457 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.098784 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.099109 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.099435 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.099761 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.100108 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.100486 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.100835 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.101164 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 18:24:55.101409 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 18:24:55.123911 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_db.sqlalchemy.engines [None req-db8b8b1f-b1f0-4113-9f72-20866e48b1c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109169) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 18:24:55.164267 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.context [None req-64371f0f-bca0-4d51-b491-5b7f2db176bd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),795c300a-6d2e-4a0e-badc-5da7a18d8918(cell1) {{(pid=109168) load_cells /opt/stack/nova/nova/context.py:464}} Oct 12 18:24:55.168743 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-64371f0f-bca0-4d51-b491-5b7f2db176bd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:24:55.170327 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-64371f0f-bca0-4d51-b491-5b7f2db176bd None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:24:55.171143 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-64371f0f-bca0-4d51-b491-5b7f2db176bd None None] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:24:55.173141 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-64371f0f-bca0-4d51-b491-5b7f2db176bd None None] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:24:55.184685 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_db.sqlalchemy.engines [None req-64371f0f-bca0-4d51-b491-5b7f2db176bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 18:24:55.185926 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_db.sqlalchemy.engines [None req-64371f0f-bca0-4d51-b491-5b7f2db176bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 18:24:55.208389 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.context [None req-db8b8b1f-b1f0-4113-9f72-20866e48b1c6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),795c300a-6d2e-4a0e-badc-5da7a18d8918(cell1) {{(pid=109169) load_cells /opt/stack/nova/nova/context.py:464}} Oct 12 18:24:55.212872 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-db8b8b1f-b1f0-4113-9f72-20866e48b1c6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:24:55.214449 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-db8b8b1f-b1f0-4113-9f72-20866e48b1c6 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:24:55.215259 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-db8b8b1f-b1f0-4113-9f72-20866e48b1c6 None None] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:24:55.217258 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-db8b8b1f-b1f0-4113-9f72-20866e48b1c6 None None] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:24:55.228546 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_db.sqlalchemy.engines [None req-db8b8b1f-b1f0-4113-9f72-20866e48b1c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109169) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 18:24:55.230463 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_db.sqlalchemy.engines [None req-db8b8b1f-b1f0-4113-9f72-20866e48b1c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109169) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 18:24:55.451437 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_db.sqlalchemy.engines [None req-64371f0f-bca0-4d51-b491-5b7f2db176bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 18:24:55.492193 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_db.sqlalchemy.engines [None req-db8b8b1f-b1f0-4113-9f72-20866e48b1c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109169) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 18:24:55.779253 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: WARNING keystonemiddleware.auth_token [None req-64371f0f-bca0-4d51-b491-5b7f2db176bd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 18:24:55.785961 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: WARNING keystonemiddleware.auth_token [None req-64371f0f-bca0-4d51-b491-5b7f2db176bd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 18:24:55.819669 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: WARNING keystonemiddleware.auth_token [None req-db8b8b1f-b1f0-4113-9f72-20866e48b1c6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 18:24:55.826422 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: WARNING keystonemiddleware.auth_token [None req-db8b8b1f-b1f0-4113-9f72-20866e48b1c6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 18:24:56.133171 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: WARNING keystonemiddleware.auth_token [None req-64371f0f-bca0-4d51-b491-5b7f2db176bd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 18:24:56.138245 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: WARNING keystonemiddleware.auth_token [None req-64371f0f-bca0-4d51-b491-5b7f2db176bd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 18:24:56.143381 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e92f25f9c0 pid: 109168 (default app) Oct 12 18:24:56.171408 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: WARNING keystonemiddleware.auth_token [None req-db8b8b1f-b1f0-4113-9f72-20866e48b1c6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 18:24:56.176957 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: WARNING keystonemiddleware.auth_token [None req-db8b8b1f-b1f0-4113-9f72-20866e48b1c6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 18:24:56.182567 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e92f25f9c0 pid: 109169 (default app) Oct 12 18:25:31.060076 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c8330858-a79a-41e5-886d-20a01aa3e6cf tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-443364804", "imageRef": "c79f0511-74c5-46f3-a7e6-cde6b09234ee", "flavorRef": "452", "networks": [{"uuid": "5abeb470-0961-42f8-b25c-58bd0d9fefe4"}]}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:25:31.413151 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-e3d7e254-44d6-44f3-ad0b-525ae2ff6162 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] Action: 'create', calling method: .version_select at 0x7fe2a5d34940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-444486157"}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:25:32.101624 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.network.neutron [None req-c8330858-a79a-41e5-886d-20a01aa3e6cf tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] validate_networks() for [('5abeb470-0961-42f8-b25c-58bd0d9fefe4', None, None, None, None, None)] {{(pid=109168) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 18:25:33.482554 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-e3d7e254-44d6-44f3-ad0b-525ae2ff6162 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.359383 Oct 12 18:25:33.491398 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 1/1] 10.222.0.18 () {60 vars in 1154 bytes} [Tue Oct 12 18:25:30 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 3362 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 12 18:25:33.497305 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-4b71e0ce-5635-48a3-8b27-e73773b44f26 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] Calling method '.version_select at 0x7fe2a5b35b80>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:33.644752 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-4b71e0ce-5635-48a3-8b27-e73773b44f26 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/75e8306e-0c46-48c8-9db6-6d49ff3f894d" status: 200 len: 344 microversion: 2.1 time: 0.151044 Oct 12 18:25:33.651459 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 2/2] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Oct 12 18:25:33 2021] GET /compute/v2.1/os-volumes/75e8306e-0c46-48c8-9db6-6d49ff3f894d => generated 344 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:25:33.758436 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-c8330858-a79a-41e5-886d-20a01aa3e6cf tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Flavor limits 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 18:25:33.759045 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-c8330858-a79a-41e5-886d-20a01aa3e6cf tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Image limits 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 18:25:33.759649 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-c8330858-a79a-41e5-886d-20a01aa3e6cf tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Flavor pref 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 18:25:33.760210 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-c8330858-a79a-41e5-886d-20a01aa3e6cf tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Image pref 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 18:25:33.760848 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-c8330858-a79a-41e5-886d-20a01aa3e6cf tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 18:25:33.807391 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c8330858-a79a-41e5-886d-20a01aa3e6cf tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:33.813696 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c8330858-a79a-41e5-886d-20a01aa3e6cf tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:33.815396 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c8330858-a79a-41e5-886d-20a01aa3e6cf tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:33.819166 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c8330858-a79a-41e5-886d-20a01aa3e6cf tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:33.897972 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-c8330858-a79a-41e5-886d-20a01aa3e6cf tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Getting quotas for project 9da6195bb2d64abfa8cd8671874f1830. Resources: {'instances', 'cores', 'ram'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:25:33.908041 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-c8330858-a79a-41e5-886d-20a01aa3e6cf tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Getting quotas for user 15239896ef4b4f50af6af54712301f5b and project 9da6195bb2d64abfa8cd8671874f1830. Resources: {'instances', 'cores', 'ram'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:25:33.921473 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c8330858-a79a-41e5-886d-20a01aa3e6cf tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Going to run 1 instances... {{(pid=109168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 18:25:33.924873 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c8330858-a79a-41e5-886d-20a01aa3e6cf tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c79f0511-74c5-46f3-a7e6-cde6b09234ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 18:25:34.111336 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-531dc74e-9e0c-44d7-a09a-cddce3bc29a6 tempest-VolumesTestJSON-1950559491 tempest-VolumesTestJSON-1950559491-project] Calling method '.version_select at 0x7fe2a5b35f70>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:34.193670 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c8330858-a79a-41e5-886d-20a01aa3e6cf tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.658618 Oct 12 18:25:34.199454 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-531dc74e-9e0c-44d7-a09a-cddce3bc29a6 tempest-VolumesTestJSON-1950559491 tempest-VolumesTestJSON-1950559491-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/fc34ea1c-a057-45b6-bebc-0d1b4595fc6d" status: 200 len: 350 microversion: 2.1 time: 0.087608 Oct 12 18:25:34.199454 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 3/3] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Oct 12 18:25:34 2021] GET /compute/v2.1/os-volumes/fc34ea1c-a057-45b6-bebc-0d1b4595fc6d => generated 350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:25:34.199881 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 1/4] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Oct 12 18:25:29 2021] POST /compute/v2.1/servers => generated 380 bytes in 4666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 18:25:34.219478 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-b631627a-f77f-4071-ab4e-1cb19aaa1a04 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:34.220244 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-b631627a-f77f-4071-ab4e-1cb19aaa1a04 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:34.577621 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-b631627a-f77f-4071-ab4e-1cb19aaa1a04 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:34.601954 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-b631627a-f77f-4071-ab4e-1cb19aaa1a04 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1214 microversion: 2.1 time: 0.401091 Oct 12 18:25:34.602539 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 4/5] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:25:34 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1214 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:25:34.669736 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-68775d5c-8cdd-41fc-bfa2-e2802a9ee63a tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] Calling method '.version_select at 0x7fe2a525e940>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:34.924814 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-68775d5c-8cdd-41fc-bfa2-e2802a9ee63a tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/75e8306e-0c46-48c8-9db6-6d49ff3f894d" status: 200 len: 345 microversion: 2.1 time: 0.267885 Oct 12 18:25:34.927197 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 2/6] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Oct 12 18:25:34 2021] GET /compute/v2.1/os-volumes/75e8306e-0c46-48c8-9db6-6d49ff3f894d => generated 345 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:25:34.969365 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-2856d7b9-78a5-4e5c-83cd-b6b3cb8ffa96 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] Action: 'create', calling method: .version_select at 0x7fe2a5acb9d0>, body: {"snapshot": {"volume_id": "75e8306e-0c46-48c8-9db6-6d49ff3f894d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-973601301"}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:25:35.620386 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8760d821-785e-401a-aa8f-9ba0f0aa49a1 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:35.621276 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8760d821-785e-401a-aa8f-9ba0f0aa49a1 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:35.721231 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8760d821-785e-401a-aa8f-9ba0f0aa49a1 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:35.721339 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-2856d7b9-78a5-4e5c-83cd-b6b3cb8ffa96 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.781472 Oct 12 18:25:35.728819 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 5/7] 10.222.0.18 () {60 vars in 1161 bytes} [Tue Oct 12 18:25:34 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:25:35.735139 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-ddd62a0b-73de-4822-b5fb-5fe0652d72e8 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] Calling method '.version_select at 0x7fe2a5a90e50>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:35.751903 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8760d821-785e-401a-aa8f-9ba0f0aa49a1 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1214 microversion: 2.1 time: 0.135564 Oct 12 18:25:35.752534 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 3/8] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:25:35 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1214 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:25:35.798279 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-ddd62a0b-73de-4822-b5fb-5fe0652d72e8 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/56ed9f9c-ba8d-4512-9650-0953a7247a2e" status: 200 len: 286 microversion: 2.1 time: 0.067685 Oct 12 18:25:35.799041 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 6/9] 10.222.0.18 () {58 vars in 1250 bytes} [Tue Oct 12 18:25:35 2021] GET /compute/v2.1/os-snapshots/56ed9f9c-ba8d-4512-9650-0953a7247a2e => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:25:35.814369 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-812a7a5f-d315-4458-903d-bf0b3bce6f0f tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] Calling method '.version_select at 0x7fe2a49e9e50>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:35.897212 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-812a7a5f-d315-4458-903d-bf0b3bce6f0f tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.090030 Oct 12 18:25:35.897781 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 4/10] 10.222.0.18 () {58 vars in 1139 bytes} [Tue Oct 12 18:25:35 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:25:35.912265 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-4fbf3b7b-4ee8-4514-86ed-f80bbef3660c tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] Calling method '.version_select at 0x7fe2a5acb4c0>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:35.963245 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-4fbf3b7b-4ee8-4514-86ed-f80bbef3660c tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/56ed9f9c-ba8d-4512-9650-0953a7247a2e" status: 200 len: 286 microversion: 2.1 time: 0.057518 Oct 12 18:25:35.964920 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 7/11] 10.222.0.18 () {58 vars in 1250 bytes} [Tue Oct 12 18:25:35 2021] GET /compute/v2.1/os-snapshots/56ed9f9c-ba8d-4512-9650-0953a7247a2e => generated 286 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:25:36.299340 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ab05fa3c-79d4-4f5b-8b30-6633110c6621 tempest-VolumesTestJSON-1950559491 tempest-VolumesTestJSON-1950559491-project] Calling method '.version_select at 0x7fe2a49fcee0>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:36.424024 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ab05fa3c-79d4-4f5b-8b30-6633110c6621 tempest-VolumesTestJSON-1950559491 tempest-VolumesTestJSON-1950559491-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/78c2e023-1553-4b59-b3c3-a6b2a695d426" status: 200 len: 350 microversion: 2.1 time: 0.128247 Oct 12 18:25:36.431545 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 5/12] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Oct 12 18:25:36 2021] GET /compute/v2.1/os-volumes/78c2e023-1553-4b59-b3c3-a6b2a695d426 => generated 350 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:25:36.773638 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-864470d5-b6dd-4dd1-a409-6ff838307381 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:36.775131 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-864470d5-b6dd-4dd1-a409-6ff838307381 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:36.982437 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-864470d5-b6dd-4dd1-a409-6ff838307381 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:36.982437 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-864470d5-b6dd-4dd1-a409-6ff838307381 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1214 microversion: 2.1 time: 0.198468 Oct 12 18:25:36.982437 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 8/13] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:25:36 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1214 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:25:36.982878 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0cc14684-4258-4b70-ba93-7fed7929a287 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] Calling method '.version_select at 0x7fe2a644b4c0>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:37.112575 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0cc14684-4258-4b70-ba93-7fed7929a287 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/56ed9f9c-ba8d-4512-9650-0953a7247a2e" status: 200 len: 286 microversion: 2.1 time: 0.139971 Oct 12 18:25:37.120697 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 6/14] 10.222.0.18 () {58 vars in 1250 bytes} [Tue Oct 12 18:25:36 2021] GET /compute/v2.1/os-snapshots/56ed9f9c-ba8d-4512-9650-0953a7247a2e => generated 286 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:25:38.030138 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-5d59a698-8f95-40f6-8c17-d594c7f4b638 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:38.039539 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-5d59a698-8f95-40f6-8c17-d594c7f4b638 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:38.046355 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5d59a698-8f95-40f6-8c17-d594c7f4b638 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:38.047293 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5d59a698-8f95-40f6-8c17-d594c7f4b638 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:38.049041 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5d59a698-8f95-40f6-8c17-d594c7f4b638 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:38.072857 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5d59a698-8f95-40f6-8c17-d594c7f4b638 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:38.127533 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-52d7f905-a17b-40a8-821c-d6a637c157b4 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] Calling method '.version_select at 0x7fe2a498d820>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:38.205718 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-52d7f905-a17b-40a8-821c-d6a637c157b4 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/56ed9f9c-ba8d-4512-9650-0953a7247a2e" status: 200 len: 286 microversion: 2.1 time: 0.083411 Oct 12 18:25:38.206413 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 7/15] 10.222.0.18 () {58 vars in 1250 bytes} [Tue Oct 12 18:25:38 2021] GET /compute/v2.1/os-snapshots/56ed9f9c-ba8d-4512-9650-0953a7247a2e => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 18:25:38.310732 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-5d59a698-8f95-40f6-8c17-d594c7f4b638 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:38.359756 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-5d59a698-8f95-40f6-8c17-d594c7f4b638 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1218 microversion: 2.1 time: 0.333790 Oct 12 18:25:38.360392 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 9/16] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:25:38 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1218 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:25:39.218395 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-57c59aca-fd82-4de1-b7af-70b1b63fa544 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] Calling method '.version_select at 0x7fe2a498dca0>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:39.260422 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-57c59aca-fd82-4de1-b7af-70b1b63fa544 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/56ed9f9c-ba8d-4512-9650-0953a7247a2e" status: 200 len: 286 microversion: 2.1 time: 0.046145 Oct 12 18:25:39.261374 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 8/17] 10.222.0.18 () {58 vars in 1250 bytes} [Tue Oct 12 18:25:39 2021] GET /compute/v2.1/os-snapshots/56ed9f9c-ba8d-4512-9650-0953a7247a2e => generated 286 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:25:39.377133 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-bc862c8d-07df-45ee-be19-111aa08b4f49 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:39.378009 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-bc862c8d-07df-45ee-be19-111aa08b4f49 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:39.383669 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bc862c8d-07df-45ee-be19-111aa08b4f49 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:39.385398 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bc862c8d-07df-45ee-be19-111aa08b4f49 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:39.385398 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bc862c8d-07df-45ee-be19-111aa08b4f49 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:39.385984 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bc862c8d-07df-45ee-be19-111aa08b4f49 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:39.565332 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-bc862c8d-07df-45ee-be19-111aa08b4f49 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:39.576255 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-bc862c8d-07df-45ee-be19-111aa08b4f49 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1218 microversion: 2.1 time: 0.202758 Oct 12 18:25:39.576892 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 10/18] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:25:39 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1218 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:25:40.273071 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4c8c56e6-4ea1-4daf-98bf-0a9719b62148 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] Calling method '.version_select at 0x7fe2a498d040>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:40.326911 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4c8c56e6-4ea1-4daf-98bf-0a9719b62148 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/56ed9f9c-ba8d-4512-9650-0953a7247a2e" status: 200 len: 286 microversion: 2.1 time: 0.058295 Oct 12 18:25:40.328462 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 9/19] 10.222.0.18 () {58 vars in 1250 bytes} [Tue Oct 12 18:25:40 2021] GET /compute/v2.1/os-snapshots/56ed9f9c-ba8d-4512-9650-0953a7247a2e => generated 286 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:25:40.605974 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-69a9ca5d-45d7-4843-bc1c-7b512561096c tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:40.613525 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-69a9ca5d-45d7-4843-bc1c-7b512561096c tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:40.672491 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-69a9ca5d-45d7-4843-bc1c-7b512561096c tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:40.689926 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-69a9ca5d-45d7-4843-bc1c-7b512561096c tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:40.693306 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-69a9ca5d-45d7-4843-bc1c-7b512561096c tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:40.701831 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-69a9ca5d-45d7-4843-bc1c-7b512561096c tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:40.936329 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-69a9ca5d-45d7-4843-bc1c-7b512561096c tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:40.944616 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-69a9ca5d-45d7-4843-bc1c-7b512561096c tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1218 microversion: 2.1 time: 0.352081 Oct 12 18:25:40.953446 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 11/20] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:25:40 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1218 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:25:41.514936 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-cee08834-edee-4b68-bdbb-9b9a35bc8d94 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] Calling method '.version_select at 0x7fe2a49fcf70>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:41.514936 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-cee08834-edee-4b68-bdbb-9b9a35bc8d94 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/56ed9f9c-ba8d-4512-9650-0953a7247a2e" status: 200 len: 287 microversion: 2.1 time: 0.154040 Oct 12 18:25:41.514936 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 10/21] 10.222.0.18 () {58 vars in 1250 bytes} [Tue Oct 12 18:25:41 2021] GET /compute/v2.1/os-snapshots/56ed9f9c-ba8d-4512-9650-0953a7247a2e => generated 287 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:25:41.514936 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c694521f-0a7b-4c31-bd91-bea8cb22d1dc tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] Calling method '.version_select at 0x7fe2a49fcb80>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:41.799725 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c694521f-0a7b-4c31-bd91-bea8cb22d1dc tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/56ed9f9c-ba8d-4512-9650-0953a7247a2e" status: 202 len: 0 microversion: 2.1 time: 0.298248 Oct 12 18:25:41.800946 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 11/22] 10.222.0.18 () {58 vars in 1253 bytes} [Tue Oct 12 18:25:41 2021] DELETE /compute/v2.1/os-snapshots/56ed9f9c-ba8d-4512-9650-0953a7247a2e => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:25:41.815307 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-81186d52-f7d3-47d2-a1d3-84082935e9b7 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] Calling method '.version_select at 0x7fe2a49e9ca0>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:41.888228 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-81186d52-f7d3-47d2-a1d3-84082935e9b7 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/56ed9f9c-ba8d-4512-9650-0953a7247a2e" status: 200 len: 286 microversion: 2.1 time: 0.077249 Oct 12 18:25:41.889199 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 12/23] 10.222.0.18 () {58 vars in 1250 bytes} [Tue Oct 12 18:25:41 2021] GET /compute/v2.1/os-snapshots/56ed9f9c-ba8d-4512-9650-0953a7247a2e => generated 286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:25:41.960539 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-6ecc48ae-4f4f-4fa4-bb18-09a6205613c1 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:41.961132 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-6ecc48ae-4f4f-4fa4-bb18-09a6205613c1 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:41.970925 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6ecc48ae-4f4f-4fa4-bb18-09a6205613c1 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:41.973330 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6ecc48ae-4f4f-4fa4-bb18-09a6205613c1 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:41.975185 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6ecc48ae-4f4f-4fa4-bb18-09a6205613c1 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:41.976590 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6ecc48ae-4f4f-4fa4-bb18-09a6205613c1 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:42.175827 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-6ecc48ae-4f4f-4fa4-bb18-09a6205613c1 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:42.203743 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-6ecc48ae-4f4f-4fa4-bb18-09a6205613c1 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1266 microversion: 2.1 time: 0.247070 Oct 12 18:25:42.213796 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 13/24] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:25:41 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:25:42.216776 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-2c35c844-a99d-42a4-ac86-2e8a6c76bdf6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'create', calling method: .version_select at 0x7fe2a5a19e50>, body: {"keypair": {"name": "tempest-keypair-551042772"}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:25:42.281979 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.quota [None req-2c35c844-a99d-42a4-ac86-2e8a6c76bdf6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Getting quotas for project 94cdd5201533434888e7691148b9a3a8. Resources: {'key_pairs'} {{(pid=109169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:25:42.287284 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-78385981-f813-4e03-ab6f-1ddcdf5145a2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'create', calling method: .version_select at 0x7fe2a490a040>, body: {"keypair": {"name": "tempest-keypair-1327013034"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:25:42.291450 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.quota [None req-2c35c844-a99d-42a4-ac86-2e8a6c76bdf6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Getting quotas for user 74acf90c734149808a501de7754b5943 and project 94cdd5201533434888e7691148b9a3a8. Resources: {'key_pairs'} {{(pid=109169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:25:42.340052 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-78385981-f813-4e03-ab6f-1ddcdf5145a2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Getting quotas for project ee04649277c84912b20967b31162615b. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:25:42.347532 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-78385981-f813-4e03-ab6f-1ddcdf5145a2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Getting quotas for user 835bbb43ae5f48bfa14b22cb0a47cb4e and project ee04649277c84912b20967b31162615b. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:25:42.654721 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-78385981-f813-4e03-ab6f-1ddcdf5145a2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Getting quotas for project ee04649277c84912b20967b31162615b. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:25:42.662376 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-78385981-f813-4e03-ab6f-1ddcdf5145a2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Getting quotas for user 835bbb43ae5f48bfa14b22cb0a47cb4e and project ee04649277c84912b20967b31162615b. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:25:42.686567 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-78385981-f813-4e03-ab6f-1ddcdf5145a2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.480281 Oct 12 18:25:42.687332 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 14/25] 10.222.0.18 () {60 vars in 1157 bytes} [Tue Oct 12 18:25:42 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:25:42.726721 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-86156589-8587-4f5b-8028-c37c4db64166 tempest-VolumesTestJSON-1950559491 tempest-VolumesTestJSON-1950559491-project] Calling method '.version_select at 0x7fe2a48cadc0>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:42.798823 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-86156589-8587-4f5b-8028-c37c4db64166 tempest-VolumesTestJSON-1950559491 tempest-VolumesTestJSON-1950559491-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/7a1e3c92-abcd-45bb-ad56-71ddd01d9a3c" status: 200 len: 348 microversion: 2.1 time: 0.102914 Oct 12 18:25:42.800068 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 15/26] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Oct 12 18:25:42 2021] GET /compute/v2.1/os-volumes/7a1e3c92-abcd-45bb-ad56-71ddd01d9a3c => generated 348 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:25:42.825505 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2c2516e3-7c29-4de4-90ce-dcfe58878a1d tempest-VolumesTestJSON-1950559491 tempest-VolumesTestJSON-1950559491-project] Calling method '.version_select at 0x7fe2a48fe280>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:43.020268 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.quota [None req-2c35c844-a99d-42a4-ac86-2e8a6c76bdf6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Getting quotas for project 94cdd5201533434888e7691148b9a3a8. Resources: {'key_pairs'} {{(pid=109169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:25:43.036075 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.quota [None req-2c35c844-a99d-42a4-ac86-2e8a6c76bdf6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Getting quotas for user 74acf90c734149808a501de7754b5943 and project 94cdd5201533434888e7691148b9a3a8. Resources: {'key_pairs'} {{(pid=109169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:25:43.086725 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-2c35c844-a99d-42a4-ac86-2e8a6c76bdf6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.727534 Oct 12 18:25:43.099416 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 12/27] 10.222.0.18 () {62 vars in 1198 bytes} [Tue Oct 12 18:25:41 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1741 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Oct 12 18:25:43.115988 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-ae57567b-cbc5-48e9-a176-5807ad588327 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] Calling method '.version_select at 0x7fe2a59b4e50>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:43.117754 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2c2516e3-7c29-4de4-90ce-dcfe58878a1d tempest-VolumesTestJSON-1950559491 tempest-VolumesTestJSON-1950559491-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1031 microversion: 2.1 time: 0.304775 Oct 12 18:25:43.128490 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 16/28] 10.222.0.18 () {58 vars in 1133 bytes} [Tue Oct 12 18:25:42 2021] GET /compute/v2.1/os-volumes => generated 1031 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:25:43.144302 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-39808711-8119-4dd0-ae6b-2ccbc1f31d1f tempest-VolumesTestJSON-1950559491 tempest-VolumesTestJSON-1950559491-project] Calling method '.version_select at 0x7fe2a49020d0>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:43.161813 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.wsgi [None req-ae57567b-cbc5-48e9-a176-5807ad588327 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] HTTP exception thrown: Snapshot 56ed9f9c-ba8d-4512-9650-0953a7247a2e could not be found. Oct 12 18:25:43.162811 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-ae57567b-cbc5-48e9-a176-5807ad588327 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] Returning 404 to user: Snapshot 56ed9f9c-ba8d-4512-9650-0953a7247a2e could not be found. {{(pid=109169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:25:43.164032 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-ae57567b-cbc5-48e9-a176-5807ad588327 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/56ed9f9c-ba8d-4512-9650-0953a7247a2e" status: 404 len: 111 microversion: 2.1 time: 0.063354 Oct 12 18:25:43.168849 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 13/29] 10.222.0.18 () {58 vars in 1250 bytes} [Tue Oct 12 18:25:43 2021] GET /compute/v2.1/os-snapshots/56ed9f9c-ba8d-4512-9650-0953a7247a2e => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:25:43.176088 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-03b29166-a4bc-4a0f-8a49-bdce0e3dacb5 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] Calling method '.version_select at 0x7fe2a5c7aca0>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:43.337591 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-39808711-8119-4dd0-ae6b-2ccbc1f31d1f tempest-VolumesTestJSON-1950559491 tempest-VolumesTestJSON-1950559491-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 691 microversion: 2.1 time: 0.199543 Oct 12 18:25:43.338559 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 17/30] 10.222.0.18 () {58 vars in 1148 bytes} [Tue Oct 12 18:25:43 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 691 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 18:25:43.350368 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c183b22a-5f0d-41b9-8322-069995a23854 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:43.351198 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c183b22a-5f0d-41b9-8322-069995a23854 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:43.374065 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c183b22a-5f0d-41b9-8322-069995a23854 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:43.374530 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c183b22a-5f0d-41b9-8322-069995a23854 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:43.378990 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c183b22a-5f0d-41b9-8322-069995a23854 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:43.378990 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c183b22a-5f0d-41b9-8322-069995a23854 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:43.595163 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c183b22a-5f0d-41b9-8322-069995a23854 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:43.659726 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c183b22a-5f0d-41b9-8322-069995a23854 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1272 microversion: 2.1 time: 0.319719 Oct 12 18:25:43.665234 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 18/31] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:25:43 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1272 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:25:43.696343 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4d2af0e8-3338-4c88-816d-8f0deb19152b tempest-VolumesTestJSON-1950559491 tempest-VolumesTestJSON-1950559491-project] Calling method '.version_select at 0x7fe2a4902820>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:44.380504 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4d2af0e8-3338-4c88-816d-8f0deb19152b tempest-VolumesTestJSON-1950559491 tempest-VolumesTestJSON-1950559491-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1031 microversion: 2.1 time: 0.710980 Oct 12 18:25:44.384355 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 19/32] 10.222.0.18 () {58 vars in 1133 bytes} [Tue Oct 12 18:25:43 2021] GET /compute/v2.1/os-volumes => generated 1031 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:25:44.386476 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-03b29166-a4bc-4a0f-8a49-bdce0e3dacb5 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/75e8306e-0c46-48c8-9db6-6d49ff3f894d" status: 202 len: 0 microversion: 2.1 time: 1.214257 Oct 12 18:25:44.387304 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 14/33] 10.222.0.18 () {58 vars in 1247 bytes} [Tue Oct 12 18:25:43 2021] DELETE /compute/v2.1/os-volumes/75e8306e-0c46-48c8-9db6-6d49ff3f894d => generated 0 bytes in 1216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:25:44.399720 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-2d53c3dd-33f0-4c37-adcf-3ba2cbd79823 tempest-VolumesTestJSON-1950559491 tempest-VolumesTestJSON-1950559491-project] Calling method '.version_select at 0x7fe2a516f670>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:44.407230 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-376a2242-dcfc-46fa-85a1-99580310801d tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] Calling method '.version_select at 0x7fe2a48fe5e0>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:44.773174 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-2d53c3dd-33f0-4c37-adcf-3ba2cbd79823 tempest-VolumesTestJSON-1950559491 tempest-VolumesTestJSON-1950559491-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.380077 Oct 12 18:25:44.773898 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 15/34] 10.222.0.18 () {58 vars in 1166 bytes} [Tue Oct 12 18:25:44 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:25:44.784544 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-6f47006f-0b78-42d9-a3dc-b03ca2bce95a tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:44.788177 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-6f47006f-0b78-42d9-a3dc-b03ca2bce95a tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:44.802332 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6f47006f-0b78-42d9-a3dc-b03ca2bce95a tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:44.807537 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6f47006f-0b78-42d9-a3dc-b03ca2bce95a tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:44.815145 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6f47006f-0b78-42d9-a3dc-b03ca2bce95a tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:44.816300 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6f47006f-0b78-42d9-a3dc-b03ca2bce95a tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:44.862637 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-376a2242-dcfc-46fa-85a1-99580310801d tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/75e8306e-0c46-48c8-9db6-6d49ff3f894d" status: 200 len: 344 microversion: 2.1 time: 0.464254 Oct 12 18:25:44.864902 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 20/35] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Oct 12 18:25:44 2021] GET /compute/v2.1/os-volumes/75e8306e-0c46-48c8-9db6-6d49ff3f894d => generated 344 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:25:44.869866 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7de6440c-bd2a-47b1-a264-5c6c9ed24499 tempest-VolumesTestJSON-1950559491 tempest-VolumesTestJSON-1950559491-project] Calling method '.version_select at 0x7fe2a48cadc0>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:45.165797 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-6f47006f-0b78-42d9-a3dc-b03ca2bce95a tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:45.175655 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-6f47006f-0b78-42d9-a3dc-b03ca2bce95a tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1272 microversion: 2.1 time: 0.399678 Oct 12 18:25:45.184435 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 16/36] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:25:44 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1272 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:25:45.202022 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7de6440c-bd2a-47b1-a264-5c6c9ed24499 tempest-VolumesTestJSON-1950559491 tempest-VolumesTestJSON-1950559491-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 691 microversion: 2.1 time: 0.335661 Oct 12 18:25:45.203064 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 21/37] 10.222.0.18 () {58 vars in 1169 bytes} [Tue Oct 12 18:25:44 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 691 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:25:45.223222 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-752ef5e0-1764-4cb5-bceb-3d2d5af23874 tempest-VolumesTestJSON-1950559491 tempest-VolumesTestJSON-1950559491-project] Calling method '.version_select at 0x7fe2a516f820>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:45.420648 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-752ef5e0-1764-4cb5-bceb-3d2d5af23874 tempest-VolumesTestJSON-1950559491 tempest-VolumesTestJSON-1950559491-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1031 microversion: 2.1 time: 0.204693 Oct 12 18:25:45.420648 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 17/38] 10.222.0.18 () {58 vars in 1154 bytes} [Tue Oct 12 18:25:45 2021] GET /compute/v2.1/os-volumes/detail => generated 1031 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:25:45.432707 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-85dd3662-8b75-475b-ae9a-a7d570f0d656 tempest-VolumesTestJSON-1950559491 tempest-VolumesTestJSON-1950559491-project] Calling method '.version_select at 0x7fe2a408fdc0>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:45.555899 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-85dd3662-8b75-475b-ae9a-a7d570f0d656 tempest-VolumesTestJSON-1950559491 tempest-VolumesTestJSON-1950559491-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.127673 Oct 12 18:25:45.556485 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 22/39] 10.222.0.18 () {58 vars in 1187 bytes} [Tue Oct 12 18:25:45 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:25:45.568463 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-9c66d6ec-cb9f-4c00-a3ee-d6d101b316b4 tempest-VolumesTestJSON-1950559491 tempest-VolumesTestJSON-1950559491-project] Calling method '.version_select at 0x7fe2a51250d0>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:45.746781 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-9c66d6ec-cb9f-4c00-a3ee-d6d101b316b4 tempest-VolumesTestJSON-1950559491 tempest-VolumesTestJSON-1950559491-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1031 microversion: 2.1 time: 0.177885 Oct 12 18:25:45.752900 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 18/40] 10.222.0.18 () {58 vars in 1154 bytes} [Tue Oct 12 18:25:45 2021] GET /compute/v2.1/os-volumes/detail => generated 1031 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:25:45.876586 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9e44e8e0-d975-4200-b929-3069a999bec3 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] Calling method '.version_select at 0x7fe2a4902d30>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:46.007605 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9e44e8e0-d975-4200-b929-3069a999bec3 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/75e8306e-0c46-48c8-9db6-6d49ff3f894d" status: 200 len: 344 microversion: 2.1 time: 0.134588 Oct 12 18:25:46.008185 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 23/41] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Oct 12 18:25:45 2021] GET /compute/v2.1/os-volumes/75e8306e-0c46-48c8-9db6-6d49ff3f894d => generated 344 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:25:46.201451 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-ef15157b-7fbf-48f2-91b9-008932b0c7c7 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:46.202247 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-ef15157b-7fbf-48f2-91b9-008932b0c7c7 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:46.215303 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ef15157b-7fbf-48f2-91b9-008932b0c7c7 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:46.216033 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ef15157b-7fbf-48f2-91b9-008932b0c7c7 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:46.219205 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ef15157b-7fbf-48f2-91b9-008932b0c7c7 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:46.220053 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ef15157b-7fbf-48f2-91b9-008932b0c7c7 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:46.558619 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-ef15157b-7fbf-48f2-91b9-008932b0c7c7 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:46.567202 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-ef15157b-7fbf-48f2-91b9-008932b0c7c7 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1314 microversion: 2.1 time: 0.369524 Oct 12 18:25:46.570473 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 19/42] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:25:46 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:25:47.036430 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-237bca54-21d8-4a1d-8715-1ff698f90298 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] Calling method '.version_select at 0x7fe2a48fe310>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:47.201359 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-237bca54-21d8-4a1d-8715-1ff698f90298 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/75e8306e-0c46-48c8-9db6-6d49ff3f894d" status: 200 len: 344 microversion: 2.1 time: 0.183702 Oct 12 18:25:47.206618 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 24/43] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Oct 12 18:25:47 2021] GET /compute/v2.1/os-volumes/75e8306e-0c46-48c8-9db6-6d49ff3f894d => generated 344 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:25:47.592768 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-07ad0bb9-8d93-4bc6-b387-9b5087a40450 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:47.593854 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-07ad0bb9-8d93-4bc6-b387-9b5087a40450 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:47.615252 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-07ad0bb9-8d93-4bc6-b387-9b5087a40450 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:47.616082 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-07ad0bb9-8d93-4bc6-b387-9b5087a40450 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:47.630096 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-07ad0bb9-8d93-4bc6-b387-9b5087a40450 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:47.630096 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-07ad0bb9-8d93-4bc6-b387-9b5087a40450 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:48.207184 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-07ad0bb9-8d93-4bc6-b387-9b5087a40450 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:48.216627 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-07ad0bb9-8d93-4bc6-b387-9b5087a40450 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1314 microversion: 2.1 time: 0.628778 Oct 12 18:25:48.218900 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d6dc89df-93e7-4e41-944b-60dc6452eaa3 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] Calling method '.version_select at 0x7fe2a4902310>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:48.235525 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 20/44] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:25:47 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1314 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:25:48.422185 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d6dc89df-93e7-4e41-944b-60dc6452eaa3 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/75e8306e-0c46-48c8-9db6-6d49ff3f894d" status: 200 len: 344 microversion: 2.1 time: 0.207268 Oct 12 18:25:48.423758 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 25/45] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Oct 12 18:25:48 2021] GET /compute/v2.1/os-volumes/75e8306e-0c46-48c8-9db6-6d49ff3f894d => generated 344 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 18:25:48.805397 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-d5d8f96d-2248-4fa7-aa31-c8877f844ae6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1746560951", "imageRef": "c79f0511-74c5-46f3-a7e6-cde6b09234ee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "80f5cd14-5950-4313-a8f0-f81c86803faa"}], "security_groups": [{"name": "tempest-securitygroup--610543398"}], "key_name": "tempest-keypair-551042772", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:25:49.088492 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.network.neutron [None req-d5d8f96d-2248-4fa7-aa31-c8877f844ae6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] validate_networks() for [('80f5cd14-5950-4313-a8f0-f81c86803faa', None, None, None, None, None)] {{(pid=109169) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 18:25:49.269878 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-95936e86-d7d9-4fbe-a12e-c85ec449a412 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:49.272331 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-95936e86-d7d9-4fbe-a12e-c85ec449a412 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:49.288190 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-95936e86-d7d9-4fbe-a12e-c85ec449a412 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:49.288940 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-95936e86-d7d9-4fbe-a12e-c85ec449a412 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:49.290156 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-95936e86-d7d9-4fbe-a12e-c85ec449a412 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:49.291449 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-95936e86-d7d9-4fbe-a12e-c85ec449a412 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:49.818689 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-95936e86-d7d9-4fbe-a12e-c85ec449a412 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:49.854064 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-95936e86-d7d9-4fbe-a12e-c85ec449a412 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1314 microversion: 2.1 time: 0.599835 Oct 12 18:25:49.856691 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 26/46] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:25:49 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1314 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:25:49.867723 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-13cad11d-ba44-43ca-9c14-bb15aa6fc5c9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1450922693", "imageRef": "c79f0511-74c5-46f3-a7e6-cde6b09234ee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c28011f7-a600-4bea-98eb-e6748c99ba11"}], "security_groups": [{"name": "tempest-securitygroup--528129212"}], "key_name": "tempest-keypair-1327013034", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:25:50.095978 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.network.neutron [None req-13cad11d-ba44-43ca-9c14-bb15aa6fc5c9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] validate_networks() for [('c28011f7-a600-4bea-98eb-e6748c99ba11', None, None, None, None, None)] {{(pid=109168) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 18:25:50.491282 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-d5d8f96d-2248-4fa7-aa31-c8877f844ae6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Flavor limits 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 18:25:50.492726 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-d5d8f96d-2248-4fa7-aa31-c8877f844ae6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Image limits 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 18:25:50.493364 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-d5d8f96d-2248-4fa7-aa31-c8877f844ae6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Flavor pref 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 18:25:50.494700 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-d5d8f96d-2248-4fa7-aa31-c8877f844ae6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Image pref 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 18:25:50.495480 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-d5d8f96d-2248-4fa7-aa31-c8877f844ae6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 18:25:50.510929 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d5d8f96d-2248-4fa7-aa31-c8877f844ae6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:50.511665 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d5d8f96d-2248-4fa7-aa31-c8877f844ae6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:50.512929 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d5d8f96d-2248-4fa7-aa31-c8877f844ae6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:50.513635 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d5d8f96d-2248-4fa7-aa31-c8877f844ae6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:50.584922 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.quota [None req-d5d8f96d-2248-4fa7-aa31-c8877f844ae6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Getting quotas for project 94cdd5201533434888e7691148b9a3a8. Resources: {'instances', 'cores', 'ram'} {{(pid=109169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:25:50.592195 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.quota [None req-d5d8f96d-2248-4fa7-aa31-c8877f844ae6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Getting quotas for user 74acf90c734149808a501de7754b5943 and project 94cdd5201533434888e7691148b9a3a8. Resources: {'instances', 'cores', 'ram'} {{(pid=109169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:25:50.607743 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-d5d8f96d-2248-4fa7-aa31-c8877f844ae6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Going to run 1 instances... {{(pid=109169) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 18:25:50.610609 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-d5d8f96d-2248-4fa7-aa31-c8877f844ae6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c79f0511-74c5-46f3-a7e6-cde6b09234ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109169) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 18:25:50.776029 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-13cad11d-ba44-43ca-9c14-bb15aa6fc5c9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Flavor limits 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 18:25:50.777258 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-13cad11d-ba44-43ca-9c14-bb15aa6fc5c9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Image limits 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 18:25:50.777887 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-13cad11d-ba44-43ca-9c14-bb15aa6fc5c9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Flavor pref 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 18:25:50.778446 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-13cad11d-ba44-43ca-9c14-bb15aa6fc5c9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Image pref 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 18:25:50.779009 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-13cad11d-ba44-43ca-9c14-bb15aa6fc5c9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 18:25:50.796036 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-13cad11d-ba44-43ca-9c14-bb15aa6fc5c9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:50.796528 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-13cad11d-ba44-43ca-9c14-bb15aa6fc5c9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:50.797358 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-13cad11d-ba44-43ca-9c14-bb15aa6fc5c9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:50.797804 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-13cad11d-ba44-43ca-9c14-bb15aa6fc5c9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:50.859706 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-13cad11d-ba44-43ca-9c14-bb15aa6fc5c9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Getting quotas for project ee04649277c84912b20967b31162615b. Resources: {'instances', 'cores', 'ram'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:25:50.878395 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-13cad11d-ba44-43ca-9c14-bb15aa6fc5c9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Getting quotas for user 835bbb43ae5f48bfa14b22cb0a47cb4e and project ee04649277c84912b20967b31162615b. Resources: {'instances', 'cores', 'ram'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:25:50.879793 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-d5d8f96d-2248-4fa7-aa31-c8877f844ae6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.079390 Oct 12 18:25:50.882822 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 21/47] 10.222.0.18 () {62 vars in 1187 bytes} [Tue Oct 12 18:25:48 2021] POST /compute/v2.1/servers => generated 401 bytes in 2083 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 18:25:50.904940 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-5ff0e906-5426-4df4-b773-147521aee2e9 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] Calling method '.version_select at 0x7fe2a50bc040>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:50.907126 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-13cad11d-ba44-43ca-9c14-bb15aa6fc5c9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Going to run 1 instances... {{(pid=109168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 18:25:50.909397 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-13cad11d-ba44-43ca-9c14-bb15aa6fc5c9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c79f0511-74c5-46f3-a7e6-cde6b09234ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 18:25:51.142285 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.wsgi [None req-5ff0e906-5426-4df4-b773-147521aee2e9 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] HTTP exception thrown: Volume 75e8306e-0c46-48c8-9db6-6d49ff3f894d could not be found. Oct 12 18:25:51.143692 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-5ff0e906-5426-4df4-b773-147521aee2e9 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] Returning 404 to user: Volume 75e8306e-0c46-48c8-9db6-6d49ff3f894d could not be found. {{(pid=109169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:25:51.145066 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-5ff0e906-5426-4df4-b773-147521aee2e9 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/75e8306e-0c46-48c8-9db6-6d49ff3f894d" status: 404 len: 109 microversion: 2.1 time: 0.260555 Oct 12 18:25:51.146406 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 22/48] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Oct 12 18:25:50 2021] GET /compute/v2.1/os-volumes/75e8306e-0c46-48c8-9db6-6d49ff3f894d => generated 109 bytes in 263 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:25:51.153822 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-5e006572-41dd-47c4-ad0d-74c795aa2d5c tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:51.155670 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-5e006572-41dd-47c4-ad0d-74c795aa2d5c tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:51.164223 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5e006572-41dd-47c4-ad0d-74c795aa2d5c tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:51.164971 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5e006572-41dd-47c4-ad0d-74c795aa2d5c tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:51.165761 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5e006572-41dd-47c4-ad0d-74c795aa2d5c tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:51.166196 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5e006572-41dd-47c4-ad0d-74c795aa2d5c tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:51.401443 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-5e006572-41dd-47c4-ad0d-74c795aa2d5c tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:51.401443 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-5e006572-41dd-47c4-ad0d-74c795aa2d5c tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1314 microversion: 2.1 time: 0.235819 Oct 12 18:25:51.401443 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 23/49] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:25:51 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:25:51.401443 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-67e9e4e8-8260-464f-ba49-fc19dddb8a27 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:51.401835 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-67e9e4e8-8260-464f-ba49-fc19dddb8a27 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:51.493878 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-67e9e4e8-8260-464f-ba49-fc19dddb8a27 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:51.502606 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-67e9e4e8-8260-464f-ba49-fc19dddb8a27 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:51.504191 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-67e9e4e8-8260-464f-ba49-fc19dddb8a27 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:51.505853 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-67e9e4e8-8260-464f-ba49-fc19dddb8a27 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1281 microversion: 2.20 time: 0.119550 Oct 12 18:25:51.506426 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 24/50] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:25:51 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1281 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:25:51.511254 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c6f1c45c-fb3b-4516-8bfb-c02a62a180d0 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] Calling method '.version_select at 0x7fe2a4048d30>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:51.555800 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-13cad11d-ba44-43ca-9c14-bb15aa6fc5c9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.700093 Oct 12 18:25:51.556612 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 27/51] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Oct 12 18:25:49 2021] POST /compute/v2.1/servers => generated 401 bytes in 1701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 18:25:51.590191 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0395ae2a-e962-433f-b9ff-9b2742db43d3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:51.590807 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0395ae2a-e962-433f-b9ff-9b2742db43d3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:51.604782 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.wsgi [None req-c6f1c45c-fb3b-4516-8bfb-c02a62a180d0 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] HTTP exception thrown: Volume 75e8306e-0c46-48c8-9db6-6d49ff3f894d could not be found. Oct 12 18:25:51.605558 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c6f1c45c-fb3b-4516-8bfb-c02a62a180d0 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] Returning 404 to user: Volume 75e8306e-0c46-48c8-9db6-6d49ff3f894d could not be found. {{(pid=109169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:25:51.606706 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c6f1c45c-fb3b-4516-8bfb-c02a62a180d0 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/75e8306e-0c46-48c8-9db6-6d49ff3f894d" status: 404 len: 109 microversion: 2.1 time: 0.099062 Oct 12 18:25:51.610431 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 25/52] 10.222.0.18 () {58 vars in 1247 bytes} [Tue Oct 12 18:25:51 2021] DELETE /compute/v2.1/os-volumes/75e8306e-0c46-48c8-9db6-6d49ff3f894d => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:25:51.630218 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-5c9c45c4-a2ac-4f18-9fc8-53ddb86fd9f9 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] Calling method '.version_select at 0x7fe2a516f4c0>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:51.709460 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0395ae2a-e962-433f-b9ff-9b2742db43d3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:51.716655 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0395ae2a-e962-433f-b9ff-9b2742db43d3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1238 microversion: 2.1 time: 0.130683 Oct 12 18:25:51.722680 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 28/53] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:25:51 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1238 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:25:51.767343 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.wsgi [None req-5c9c45c4-a2ac-4f18-9fc8-53ddb86fd9f9 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] HTTP exception thrown: Volume 75e8306e-0c46-48c8-9db6-6d49ff3f894d could not be found. Oct 12 18:25:51.767992 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-5c9c45c4-a2ac-4f18-9fc8-53ddb86fd9f9 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] Returning 404 to user: Volume 75e8306e-0c46-48c8-9db6-6d49ff3f894d could not be found. {{(pid=109169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:25:51.768895 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-5c9c45c4-a2ac-4f18-9fc8-53ddb86fd9f9 tempest-VolumesSnapshotsTestJSON-2019531105 tempest-VolumesSnapshotsTestJSON-2019531105-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/75e8306e-0c46-48c8-9db6-6d49ff3f894d" status: 404 len: 109 microversion: 2.1 time: 0.150358 Oct 12 18:25:51.769439 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 26/54] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Oct 12 18:25:51 2021] GET /compute/v2.1/os-volumes/75e8306e-0c46-48c8-9db6-6d49ff3f894d => generated 109 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 18:25:52.406581 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ad5184e2-4d01-4cfa-9404-0dcde7102a2e tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:52.407279 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ad5184e2-4d01-4cfa-9404-0dcde7102a2e tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:52.416319 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ad5184e2-4d01-4cfa-9404-0dcde7102a2e tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:52.417013 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ad5184e2-4d01-4cfa-9404-0dcde7102a2e tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:52.417799 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ad5184e2-4d01-4cfa-9404-0dcde7102a2e tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:52.418238 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ad5184e2-4d01-4cfa-9404-0dcde7102a2e tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:52.524987 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-0909e91f-9ae6-4285-afc3-204c38e97be7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:52.526533 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-0909e91f-9ae6-4285-afc3-204c38e97be7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:52.659499 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-0909e91f-9ae6-4285-afc3-204c38e97be7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:52.667963 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ad5184e2-4d01-4cfa-9404-0dcde7102a2e tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:52.669590 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-0909e91f-9ae6-4285-afc3-204c38e97be7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:52.671463 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-0909e91f-9ae6-4285-afc3-204c38e97be7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:52.672781 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-0909e91f-9ae6-4285-afc3-204c38e97be7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1281 microversion: 2.20 time: 0.151876 Oct 12 18:25:52.674088 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 27/55] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:25:52 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1281 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:25:52.687834 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ad5184e2-4d01-4cfa-9404-0dcde7102a2e tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1314 microversion: 2.1 time: 0.284474 Oct 12 18:25:52.696812 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 29/56] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:25:52 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:25:52.753384 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c90a8f59-cfb0-4f59-9de5-3370716a6d89 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:52.753384 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c90a8f59-cfb0-4f59-9de5-3370716a6d89 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:52.860576 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c90a8f59-cfb0-4f59-9de5-3370716a6d89 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:52.868116 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c90a8f59-cfb0-4f59-9de5-3370716a6d89 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1238 microversion: 2.1 time: 0.122613 Oct 12 18:25:52.868738 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 28/57] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:25:52 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1238 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:25:53.693278 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ffa9986f-ffc7-4de6-b7c3-ed9fc89d2ffe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:53.694586 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ffa9986f-ffc7-4de6-b7c3-ed9fc89d2ffe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:53.700625 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ffa9986f-ffc7-4de6-b7c3-ed9fc89d2ffe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:53.701239 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ffa9986f-ffc7-4de6-b7c3-ed9fc89d2ffe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:53.702023 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ffa9986f-ffc7-4de6-b7c3-ed9fc89d2ffe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:53.702465 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ffa9986f-ffc7-4de6-b7c3-ed9fc89d2ffe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:53.715581 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-12701fc8-2311-46d8-b9e5-d867555f39ec tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:53.719333 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-12701fc8-2311-46d8-b9e5-d867555f39ec tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:53.737976 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-12701fc8-2311-46d8-b9e5-d867555f39ec tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:53.738616 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-12701fc8-2311-46d8-b9e5-d867555f39ec tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:53.740167 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-12701fc8-2311-46d8-b9e5-d867555f39ec tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:53.740838 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-12701fc8-2311-46d8-b9e5-d867555f39ec tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:53.812241 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ffa9986f-ffc7-4de6-b7c3-ed9fc89d2ffe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:53.824656 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ffa9986f-ffc7-4de6-b7c3-ed9fc89d2ffe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:53.833516 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ffa9986f-ffc7-4de6-b7c3-ed9fc89d2ffe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:53.834734 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ffa9986f-ffc7-4de6-b7c3-ed9fc89d2ffe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1285 microversion: 2.20 time: 0.145543 Oct 12 18:25:53.844564 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 30/58] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:25:53 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1285 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:25:53.952771 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-12744333-6c4c-4015-9674-3b0b0dcce6df tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:53.954210 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-12744333-6c4c-4015-9674-3b0b0dcce6df tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:53.979839 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-12744333-6c4c-4015-9674-3b0b0dcce6df tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:53.980429 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-12744333-6c4c-4015-9674-3b0b0dcce6df tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:53.981361 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-12744333-6c4c-4015-9674-3b0b0dcce6df tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:53.982945 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-12744333-6c4c-4015-9674-3b0b0dcce6df tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:53.984984 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-12701fc8-2311-46d8-b9e5-d867555f39ec tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:53.993516 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-12701fc8-2311-46d8-b9e5-d867555f39ec tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1314 microversion: 2.1 time: 0.281022 Oct 12 18:25:53.996557 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 29/59] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:25:53 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:25:54.095065 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-12744333-6c4c-4015-9674-3b0b0dcce6df tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:54.108468 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-12744333-6c4c-4015-9674-3b0b0dcce6df tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1242 microversion: 2.1 time: 0.163476 Oct 12 18:25:54.110106 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 31/60] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:25:53 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1242 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:25:54.861701 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-efeb81e8-1d36-49ba-8257-8a924398ccfe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:54.862335 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-efeb81e8-1d36-49ba-8257-8a924398ccfe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:54.871191 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-efeb81e8-1d36-49ba-8257-8a924398ccfe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:54.871912 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-efeb81e8-1d36-49ba-8257-8a924398ccfe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:54.879028 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-efeb81e8-1d36-49ba-8257-8a924398ccfe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:54.879028 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-efeb81e8-1d36-49ba-8257-8a924398ccfe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:54.953225 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-efeb81e8-1d36-49ba-8257-8a924398ccfe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:54.964733 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-efeb81e8-1d36-49ba-8257-8a924398ccfe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:54.966455 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-efeb81e8-1d36-49ba-8257-8a924398ccfe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:54.967596 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-efeb81e8-1d36-49ba-8257-8a924398ccfe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1285 microversion: 2.20 time: 0.110566 Oct 12 18:25:54.968266 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 30/61] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:25:54 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:25:55.016568 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8c8337bf-ec9a-4e61-a604-a44671ad61d5 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:55.017635 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8c8337bf-ec9a-4e61-a604-a44671ad61d5 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:55.039596 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8c8337bf-ec9a-4e61-a604-a44671ad61d5 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:55.039596 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8c8337bf-ec9a-4e61-a604-a44671ad61d5 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:55.041656 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8c8337bf-ec9a-4e61-a604-a44671ad61d5 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:55.042433 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8c8337bf-ec9a-4e61-a604-a44671ad61d5 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:55.201775 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-14ef904d-e649-48d1-97ff-369975604520 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:55.203209 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-14ef904d-e649-48d1-97ff-369975604520 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:55.240563 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-14ef904d-e649-48d1-97ff-369975604520 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:55.243964 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-14ef904d-e649-48d1-97ff-369975604520 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:55.247016 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-14ef904d-e649-48d1-97ff-369975604520 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:55.248553 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-14ef904d-e649-48d1-97ff-369975604520 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:55.378066 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-14ef904d-e649-48d1-97ff-369975604520 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:55.386703 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-14ef904d-e649-48d1-97ff-369975604520 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1242 microversion: 2.1 time: 0.194333 Oct 12 18:25:55.387728 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 31/62] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:25:55 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1242 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:25:55.388750 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8c8337bf-ec9a-4e61-a604-a44671ad61d5 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:55.401935 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8c8337bf-ec9a-4e61-a604-a44671ad61d5 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1314 microversion: 2.1 time: 0.393247 Oct 12 18:25:55.402887 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 32/63] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:25:55 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:25:55.987380 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-78c82a42-b15a-4ea8-b25a-441de733932a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:55.990564 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-78c82a42-b15a-4ea8-b25a-441de733932a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:56.003076 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-78c82a42-b15a-4ea8-b25a-441de733932a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:56.003527 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-78c82a42-b15a-4ea8-b25a-441de733932a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:56.005152 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-78c82a42-b15a-4ea8-b25a-441de733932a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:56.007722 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-78c82a42-b15a-4ea8-b25a-441de733932a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:56.086352 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-78c82a42-b15a-4ea8-b25a-441de733932a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:56.097296 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-78c82a42-b15a-4ea8-b25a-441de733932a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:56.098914 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-78c82a42-b15a-4ea8-b25a-441de733932a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:56.100031 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-78c82a42-b15a-4ea8-b25a-441de733932a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1285 microversion: 2.20 time: 0.117141 Oct 12 18:25:56.101073 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 32/64] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:25:55 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:25:56.403649 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-059a4ab9-9cf9-44be-9af5-8b5ccb747118 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:56.404262 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-059a4ab9-9cf9-44be-9af5-8b5ccb747118 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:56.410684 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-059a4ab9-9cf9-44be-9af5-8b5ccb747118 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:56.411138 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-059a4ab9-9cf9-44be-9af5-8b5ccb747118 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:56.411918 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-059a4ab9-9cf9-44be-9af5-8b5ccb747118 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:56.412532 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-059a4ab9-9cf9-44be-9af5-8b5ccb747118 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:56.427575 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-46e56662-9121-4cc1-a9db-75869c6d12df tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:56.428644 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-46e56662-9121-4cc1-a9db-75869c6d12df tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:56.438401 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-46e56662-9121-4cc1-a9db-75869c6d12df tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:56.438856 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-46e56662-9121-4cc1-a9db-75869c6d12df tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:56.439636 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-46e56662-9121-4cc1-a9db-75869c6d12df tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:56.440069 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-46e56662-9121-4cc1-a9db-75869c6d12df tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:56.531552 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-059a4ab9-9cf9-44be-9af5-8b5ccb747118 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:56.539603 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-059a4ab9-9cf9-44be-9af5-8b5ccb747118 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1242 microversion: 2.1 time: 0.139974 Oct 12 18:25:56.540207 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 33/65] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:25:56 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1242 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:25:56.615900 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-46e56662-9121-4cc1-a9db-75869c6d12df tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:56.632900 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-46e56662-9121-4cc1-a9db-75869c6d12df tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1314 microversion: 2.1 time: 0.209853 Oct 12 18:25:56.644113 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 33/66] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:25:56 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:25:57.124047 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-fea01eee-2fb8-45f4-8403-c8e25b6bba81 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:57.125178 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-fea01eee-2fb8-45f4-8403-c8e25b6bba81 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:57.135141 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fea01eee-2fb8-45f4-8403-c8e25b6bba81 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:57.136245 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fea01eee-2fb8-45f4-8403-c8e25b6bba81 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:57.137784 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fea01eee-2fb8-45f4-8403-c8e25b6bba81 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:57.138701 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fea01eee-2fb8-45f4-8403-c8e25b6bba81 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:57.276632 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-fea01eee-2fb8-45f4-8403-c8e25b6bba81 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:57.306636 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-fea01eee-2fb8-45f4-8403-c8e25b6bba81 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:57.308221 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-fea01eee-2fb8-45f4-8403-c8e25b6bba81 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:57.309303 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-fea01eee-2fb8-45f4-8403-c8e25b6bba81 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1285 microversion: 2.20 time: 0.192897 Oct 12 18:25:57.311742 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 34/67] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:25:57 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1285 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:25:57.557393 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-f4b3c796-d9f6-408d-851a-5b672992e1f5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:57.558010 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-f4b3c796-d9f6-408d-851a-5b672992e1f5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:57.563919 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f4b3c796-d9f6-408d-851a-5b672992e1f5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:57.564487 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f4b3c796-d9f6-408d-851a-5b672992e1f5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:57.565270 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f4b3c796-d9f6-408d-851a-5b672992e1f5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:57.565708 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f4b3c796-d9f6-408d-851a-5b672992e1f5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:57.646559 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-f4b3c796-d9f6-408d-851a-5b672992e1f5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:57.653753 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-fedcdd51-23e3-4f30-9f47-9d1653ff8a70 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:57.653753 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-fedcdd51-23e3-4f30-9f47-9d1653ff8a70 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:57.654913 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-f4b3c796-d9f6-408d-851a-5b672992e1f5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1242 microversion: 2.1 time: 0.100777 Oct 12 18:25:57.655547 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 34/68] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:25:57 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1242 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:25:57.657845 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fedcdd51-23e3-4f30-9f47-9d1653ff8a70 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:57.658563 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fedcdd51-23e3-4f30-9f47-9d1653ff8a70 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:57.659468 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fedcdd51-23e3-4f30-9f47-9d1653ff8a70 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:57.660139 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fedcdd51-23e3-4f30-9f47-9d1653ff8a70 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:57.792666 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-fedcdd51-23e3-4f30-9f47-9d1653ff8a70 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:57.803380 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-fedcdd51-23e3-4f30-9f47-9d1653ff8a70 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1314 microversion: 2.1 time: 0.157274 Oct 12 18:25:57.804255 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 35/69] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:25:57 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:25:58.340240 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-73ecf767-e9b6-4899-aac0-34fe909da7b6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:58.340800 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-73ecf767-e9b6-4899-aac0-34fe909da7b6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:58.347580 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-73ecf767-e9b6-4899-aac0-34fe909da7b6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:58.348851 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-73ecf767-e9b6-4899-aac0-34fe909da7b6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:58.349808 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-73ecf767-e9b6-4899-aac0-34fe909da7b6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:58.350244 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-73ecf767-e9b6-4899-aac0-34fe909da7b6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:58.431952 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-73ecf767-e9b6-4899-aac0-34fe909da7b6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:58.440692 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-73ecf767-e9b6-4899-aac0-34fe909da7b6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:58.442266 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-73ecf767-e9b6-4899-aac0-34fe909da7b6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:58.443849 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-73ecf767-e9b6-4899-aac0-34fe909da7b6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1285 microversion: 2.20 time: 0.107194 Oct 12 18:25:58.445716 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 35/70] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:25:58 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:25:58.676693 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-911b98e5-b939-4b1d-b520-bd98ec2660bf tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:58.678151 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-911b98e5-b939-4b1d-b520-bd98ec2660bf tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:58.690026 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-911b98e5-b939-4b1d-b520-bd98ec2660bf tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:58.691290 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-911b98e5-b939-4b1d-b520-bd98ec2660bf tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:58.695266 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-911b98e5-b939-4b1d-b520-bd98ec2660bf tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:58.696249 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-911b98e5-b939-4b1d-b520-bd98ec2660bf tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:58.804906 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-911b98e5-b939-4b1d-b520-bd98ec2660bf tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:58.813688 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-911b98e5-b939-4b1d-b520-bd98ec2660bf tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1242 microversion: 2.1 time: 0.145213 Oct 12 18:25:58.827065 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 36/71] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:25:58 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1242 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:25:58.833514 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-540fefc1-8672-4f75-83a1-31d990671d40 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:58.840782 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-540fefc1-8672-4f75-83a1-31d990671d40 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:58.853517 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-540fefc1-8672-4f75-83a1-31d990671d40 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:58.854467 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-540fefc1-8672-4f75-83a1-31d990671d40 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:58.855970 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-540fefc1-8672-4f75-83a1-31d990671d40 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:58.856925 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-540fefc1-8672-4f75-83a1-31d990671d40 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:59.157484 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-540fefc1-8672-4f75-83a1-31d990671d40 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:59.175868 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-540fefc1-8672-4f75-83a1-31d990671d40 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1314 microversion: 2.1 time: 0.357870 Oct 12 18:25:59.177651 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 36/72] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:25:58 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:25:59.475975 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-63601e72-7247-445d-ae8e-b7307ecbb514 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:59.477264 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-63601e72-7247-445d-ae8e-b7307ecbb514 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:59.489724 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-63601e72-7247-445d-ae8e-b7307ecbb514 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:59.490621 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-63601e72-7247-445d-ae8e-b7307ecbb514 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:59.491996 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-63601e72-7247-445d-ae8e-b7307ecbb514 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:59.492962 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-63601e72-7247-445d-ae8e-b7307ecbb514 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:59.577520 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-63601e72-7247-445d-ae8e-b7307ecbb514 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:59.585309 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-63601e72-7247-445d-ae8e-b7307ecbb514 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:59.586801 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-63601e72-7247-445d-ae8e-b7307ecbb514 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:59.587897 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-63601e72-7247-445d-ae8e-b7307ecbb514 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1285 microversion: 2.20 time: 0.118074 Oct 12 18:25:59.588647 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 37/73] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:25:59 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:25:59.836095 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-71730593-a93a-4d18-980a-c6682aaa5248 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:25:59.836828 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-71730593-a93a-4d18-980a-c6682aaa5248 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:25:59.843297 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-71730593-a93a-4d18-980a-c6682aaa5248 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:59.843856 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-71730593-a93a-4d18-980a-c6682aaa5248 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:59.844831 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-71730593-a93a-4d18-980a-c6682aaa5248 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:25:59.845473 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-71730593-a93a-4d18-980a-c6682aaa5248 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:25:59.932925 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-71730593-a93a-4d18-980a-c6682aaa5248 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:25:59.940213 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-71730593-a93a-4d18-980a-c6682aaa5248 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1242 microversion: 2.1 time: 0.108369 Oct 12 18:25:59.940849 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 37/74] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:25:59 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1242 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:26:00.194200 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-066b68d6-2d33-4c41-9f0d-dfd275898108 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:00.194714 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-066b68d6-2d33-4c41-9f0d-dfd275898108 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:00.200996 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-066b68d6-2d33-4c41-9f0d-dfd275898108 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:00.202596 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-066b68d6-2d33-4c41-9f0d-dfd275898108 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:00.202596 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-066b68d6-2d33-4c41-9f0d-dfd275898108 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:00.202892 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-066b68d6-2d33-4c41-9f0d-dfd275898108 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:00.415338 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-066b68d6-2d33-4c41-9f0d-dfd275898108 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:00.423984 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-066b68d6-2d33-4c41-9f0d-dfd275898108 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1314 microversion: 2.1 time: 0.234301 Oct 12 18:26:00.433671 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 38/75] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:00 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:26:00.606640 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-bc609402-8e51-4a70-ba7b-0903fa2a9f0e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:00.607437 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-bc609402-8e51-4a70-ba7b-0903fa2a9f0e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:00.619181 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bc609402-8e51-4a70-ba7b-0903fa2a9f0e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:00.619883 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bc609402-8e51-4a70-ba7b-0903fa2a9f0e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:00.622167 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bc609402-8e51-4a70-ba7b-0903fa2a9f0e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:00.622787 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bc609402-8e51-4a70-ba7b-0903fa2a9f0e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:00.696992 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-bc609402-8e51-4a70-ba7b-0903fa2a9f0e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:00.705155 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-bc609402-8e51-4a70-ba7b-0903fa2a9f0e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:00.707460 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-bc609402-8e51-4a70-ba7b-0903fa2a9f0e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:00.709188 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-bc609402-8e51-4a70-ba7b-0903fa2a9f0e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1285 microversion: 2.20 time: 0.106265 Oct 12 18:26:00.709955 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 38/76] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:26:00 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:26:00.957184 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-85121cb0-39db-4cf6-88f2-70a003dc312f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:00.958341 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-85121cb0-39db-4cf6-88f2-70a003dc312f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:00.965208 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-85121cb0-39db-4cf6-88f2-70a003dc312f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:00.965819 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-85121cb0-39db-4cf6-88f2-70a003dc312f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:00.966740 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-85121cb0-39db-4cf6-88f2-70a003dc312f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:00.967341 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-85121cb0-39db-4cf6-88f2-70a003dc312f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:01.048483 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-85121cb0-39db-4cf6-88f2-70a003dc312f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:01.056145 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-85121cb0-39db-4cf6-88f2-70a003dc312f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1234 microversion: 2.1 time: 0.102717 Oct 12 18:26:01.056740 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 39/77] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:00 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1234 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:26:01.442805 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-48535051-316e-4e18-a2e3-75625a44cb3f tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:01.444205 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-48535051-316e-4e18-a2e3-75625a44cb3f tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:01.471648 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-48535051-316e-4e18-a2e3-75625a44cb3f tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:01.479498 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-48535051-316e-4e18-a2e3-75625a44cb3f tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:01.480882 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-48535051-316e-4e18-a2e3-75625a44cb3f tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:01.482606 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-48535051-316e-4e18-a2e3-75625a44cb3f tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:01.727685 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-de1a664f-13ba-435d-aaaa-fcb4f2c13906 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:01.728318 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-de1a664f-13ba-435d-aaaa-fcb4f2c13906 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:01.736828 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-de1a664f-13ba-435d-aaaa-fcb4f2c13906 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:01.737191 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-de1a664f-13ba-435d-aaaa-fcb4f2c13906 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:01.737968 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-de1a664f-13ba-435d-aaaa-fcb4f2c13906 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:01.738396 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-de1a664f-13ba-435d-aaaa-fcb4f2c13906 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:01.909254 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-de1a664f-13ba-435d-aaaa-fcb4f2c13906 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:01.924451 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-de1a664f-13ba-435d-aaaa-fcb4f2c13906 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:01.930441 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-de1a664f-13ba-435d-aaaa-fcb4f2c13906 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:01.931924 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-de1a664f-13ba-435d-aaaa-fcb4f2c13906 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1341 microversion: 2.20 time: 0.208471 Oct 12 18:26:01.935481 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 40/78] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:26:01 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1341 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:26:02.073383 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7ec59eb7-224c-4ef9-9bbe-c4901b6bb7f6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:02.074008 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7ec59eb7-224c-4ef9-9bbe-c4901b6bb7f6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:02.090283 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7ec59eb7-224c-4ef9-9bbe-c4901b6bb7f6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:02.090720 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7ec59eb7-224c-4ef9-9bbe-c4901b6bb7f6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:02.091771 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7ec59eb7-224c-4ef9-9bbe-c4901b6bb7f6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:02.092383 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7ec59eb7-224c-4ef9-9bbe-c4901b6bb7f6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:02.333782 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7ec59eb7-224c-4ef9-9bbe-c4901b6bb7f6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:02.352116 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7ec59eb7-224c-4ef9-9bbe-c4901b6bb7f6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1290 microversion: 2.1 time: 0.281998 Oct 12 18:26:02.362560 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 41/79] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:02 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1290 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:26:02.420979 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-48535051-316e-4e18-a2e3-75625a44cb3f tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:02.433520 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-48535051-316e-4e18-a2e3-75625a44cb3f tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1314 microversion: 2.1 time: 0.995541 Oct 12 18:26:02.435223 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 39/80] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:01 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1314 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:26:02.954651 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-97d48cc6-1a60-4df7-ba51-795cf7000ce2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:02.956921 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-97d48cc6-1a60-4df7-ba51-795cf7000ce2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:02.964055 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-97d48cc6-1a60-4df7-ba51-795cf7000ce2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:02.969777 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-97d48cc6-1a60-4df7-ba51-795cf7000ce2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:02.969777 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-97d48cc6-1a60-4df7-ba51-795cf7000ce2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:02.969777 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-97d48cc6-1a60-4df7-ba51-795cf7000ce2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:03.218895 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-97d48cc6-1a60-4df7-ba51-795cf7000ce2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:03.231882 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-97d48cc6-1a60-4df7-ba51-795cf7000ce2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:03.235009 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-97d48cc6-1a60-4df7-ba51-795cf7000ce2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:03.237569 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-97d48cc6-1a60-4df7-ba51-795cf7000ce2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1339 microversion: 2.20 time: 0.287104 Oct 12 18:26:03.239232 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 42/81] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:26:02 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1339 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:26:03.372359 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-e526cabd-03a0-452d-9bd8-7675ebb788d1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:03.375774 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-e526cabd-03a0-452d-9bd8-7675ebb788d1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:03.399244 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e526cabd-03a0-452d-9bd8-7675ebb788d1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:03.400278 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e526cabd-03a0-452d-9bd8-7675ebb788d1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:03.401383 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e526cabd-03a0-452d-9bd8-7675ebb788d1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:03.406215 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e526cabd-03a0-452d-9bd8-7675ebb788d1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:03.451281 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a0f302c0-82d0-4bcc-92fa-64020b4a2808 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:03.452208 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a0f302c0-82d0-4bcc-92fa-64020b4a2808 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:03.462753 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a0f302c0-82d0-4bcc-92fa-64020b4a2808 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:03.464065 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a0f302c0-82d0-4bcc-92fa-64020b4a2808 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:03.465094 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a0f302c0-82d0-4bcc-92fa-64020b4a2808 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:03.465516 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a0f302c0-82d0-4bcc-92fa-64020b4a2808 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:03.527809 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-e526cabd-03a0-452d-9bd8-7675ebb788d1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:03.539413 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-e526cabd-03a0-452d-9bd8-7675ebb788d1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1296 microversion: 2.1 time: 0.168348 Oct 12 18:26:03.540716 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 40/82] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:03 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1296 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:26:03.746960 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a0f302c0-82d0-4bcc-92fa-64020b4a2808 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:03.759746 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a0f302c0-82d0-4bcc-92fa-64020b4a2808 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1314 microversion: 2.1 time: 0.312335 Oct 12 18:26:03.763001 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 43/83] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:03 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:26:04.265123 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-59296844-bfb8-4435-9606-80f03f0edea5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:04.265942 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-59296844-bfb8-4435-9606-80f03f0edea5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:04.281195 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-59296844-bfb8-4435-9606-80f03f0edea5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:04.283236 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-59296844-bfb8-4435-9606-80f03f0edea5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:04.284290 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-59296844-bfb8-4435-9606-80f03f0edea5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:04.285110 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-59296844-bfb8-4435-9606-80f03f0edea5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:04.559670 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-99264103-e0bc-4a04-a45d-78c9880dd7b1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:04.560970 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-99264103-e0bc-4a04-a45d-78c9880dd7b1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:04.578329 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-99264103-e0bc-4a04-a45d-78c9880dd7b1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:04.579194 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-99264103-e0bc-4a04-a45d-78c9880dd7b1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:04.581678 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-99264103-e0bc-4a04-a45d-78c9880dd7b1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:04.586725 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-99264103-e0bc-4a04-a45d-78c9880dd7b1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:04.686523 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-59296844-bfb8-4435-9606-80f03f0edea5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:04.712514 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-59296844-bfb8-4435-9606-80f03f0edea5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:04.715353 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-59296844-bfb8-4435-9606-80f03f0edea5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:04.717153 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-59296844-bfb8-4435-9606-80f03f0edea5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1406 microversion: 2.20 time: 0.455873 Oct 12 18:26:04.717980 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 41/84] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:26:04 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1406 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:26:04.783757 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-bb50ef2b-f9df-49b7-b733-66836008235c tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:04.784735 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-bb50ef2b-f9df-49b7-b733-66836008235c tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:04.804556 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bb50ef2b-f9df-49b7-b733-66836008235c tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:04.806231 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bb50ef2b-f9df-49b7-b733-66836008235c tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:04.812554 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bb50ef2b-f9df-49b7-b733-66836008235c tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:04.813221 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bb50ef2b-f9df-49b7-b733-66836008235c tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:05.413761 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-99264103-e0bc-4a04-a45d-78c9880dd7b1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:05.424878 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-bb50ef2b-f9df-49b7-b733-66836008235c tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:05.426867 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-99264103-e0bc-4a04-a45d-78c9880dd7b1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1363 microversion: 2.1 time: 0.873587 Oct 12 18:26:05.434722 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 44/85] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:04 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1363 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:26:05.450422 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-bb50ef2b-f9df-49b7-b733-66836008235c tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1314 microversion: 2.1 time: 0.669366 Oct 12 18:26:05.469877 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 42/86] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:04 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1314 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:26:05.738854 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-6100c19c-011a-429f-8a9a-1c104bdcf2cc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:05.740196 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-6100c19c-011a-429f-8a9a-1c104bdcf2cc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:05.749615 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6100c19c-011a-429f-8a9a-1c104bdcf2cc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:05.751920 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6100c19c-011a-429f-8a9a-1c104bdcf2cc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:05.753077 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6100c19c-011a-429f-8a9a-1c104bdcf2cc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:05.763670 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6100c19c-011a-429f-8a9a-1c104bdcf2cc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:05.925131 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-3a5d81e4-7552-46e8-bec2-234a41d5e66f req-49f30f98-1273-4be5-af05-8f7085d3ff41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b41fbf9-05a2-46c9-b7a6-124028aa23ab", "tag": "b2fef676-0c4d-4948-82ee-4d56b09e2840"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:05.928481 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:26:05.928481 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:26:05.951700 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-3a5d81e4-7552-46e8-bec2-234a41d5e66f req-49f30f98-1273-4be5-af05-8f7085d3ff41 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:05.952322 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-3a5d81e4-7552-46e8-bec2-234a41d5e66f req-49f30f98-1273-4be5-af05-8f7085d3ff41 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:06.027660 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-3a5d81e4-7552-46e8-bec2-234a41d5e66f req-49f30f98-1273-4be5-af05-8f7085d3ff41 service nova] Creating event network-changed:b2fef676-0c4d-4948-82ee-4d56b09e2840 for instance 7b41fbf9-05a2-46c9-b7a6-124028aa23ab on hv-cinder-81322 Oct 12 18:26:06.034426 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-3a5d81e4-7552-46e8-bec2-234a41d5e66f req-49f30f98-1273-4be5-af05-8f7085d3ff41 service nova] Acquired lock "compute-rpcapi-router" {{(pid=109168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 12 18:26:06.035997 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2da88e61-acc7-411a-b9ad-2e6cb701f00b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:06.037560 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2da88e61-acc7-411a-b9ad-2e6cb701f00b None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:06.046420 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2da88e61-acc7-411a-b9ad-2e6cb701f00b None None] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:06.047103 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2da88e61-acc7-411a-b9ad-2e6cb701f00b None None] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:06.095412 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.compute.rpcapi [None req-2da88e61-acc7-411a-b9ad-2e6cb701f00b None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 12 18:26:06.095412 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2da88e61-acc7-411a-b9ad-2e6cb701f00b None None] Releasing lock "compute-rpcapi-router" {{(pid=109168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 12 18:26:06.149006 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2da88e61-acc7-411a-b9ad-2e6cb701f00b None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.711484 Oct 12 18:26:06.150015 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 45/87] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:26:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:26:06.263184 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-6100c19c-011a-429f-8a9a-1c104bdcf2cc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:06.277617 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-6100c19c-011a-429f-8a9a-1c104bdcf2cc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:06.280050 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-6100c19c-011a-429f-8a9a-1c104bdcf2cc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:06.281482 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-6100c19c-011a-429f-8a9a-1c104bdcf2cc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1406 microversion: 2.20 time: 0.546649 Oct 12 18:26:06.283165 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 43/88] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:26:05 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1406 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:26:06.447011 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-624ab132-3e72-41ac-9905-c11e591f8419 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:06.448375 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-624ab132-3e72-41ac-9905-c11e591f8419 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:06.456009 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-624ab132-3e72-41ac-9905-c11e591f8419 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:06.457369 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-624ab132-3e72-41ac-9905-c11e591f8419 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:06.458321 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-624ab132-3e72-41ac-9905-c11e591f8419 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:06.459499 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-624ab132-3e72-41ac-9905-c11e591f8419 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:06.479406 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-fbd520b1-4e27-4b3e-901f-7f2fd609b85f tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:06.480527 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-fbd520b1-4e27-4b3e-901f-7f2fd609b85f tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:06.491782 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fbd520b1-4e27-4b3e-901f-7f2fd609b85f tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:06.494207 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fbd520b1-4e27-4b3e-901f-7f2fd609b85f tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:06.494941 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fbd520b1-4e27-4b3e-901f-7f2fd609b85f tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:06.495458 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fbd520b1-4e27-4b3e-901f-7f2fd609b85f tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:07.016632 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-624ab132-3e72-41ac-9905-c11e591f8419 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:07.025471 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-624ab132-3e72-41ac-9905-c11e591f8419 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1363 microversion: 2.1 time: 0.582876 Oct 12 18:26:07.030719 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 46/89] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:06 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1363 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:26:07.053957 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-fbd520b1-4e27-4b3e-901f-7f2fd609b85f tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:07.063623 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-fbd520b1-4e27-4b3e-901f-7f2fd609b85f tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1314 microversion: 2.1 time: 0.589439 Oct 12 18:26:07.066423 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 44/90] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:06 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1314 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:26:07.310020 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-bc4f4aea-c8dd-4e90-a5c9-de8b2d22e734 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:07.316985 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-bc4f4aea-c8dd-4e90-a5c9-de8b2d22e734 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:07.329874 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bc4f4aea-c8dd-4e90-a5c9-de8b2d22e734 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:07.330420 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bc4f4aea-c8dd-4e90-a5c9-de8b2d22e734 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:07.331113 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bc4f4aea-c8dd-4e90-a5c9-de8b2d22e734 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:07.331537 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bc4f4aea-c8dd-4e90-a5c9-de8b2d22e734 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:07.663284 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-2d5dfca1-058d-4ee2-a4bc-72edff934c48 req-67d275f6-595f-4220-b793-0220915d1306 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ad61db5-995d-47f1-a6d6-891628733252", "tag": "e09e7894-b521-40f8-ae1f-7364d6e573c9"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:07.666720 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:26:07.666720 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:26:07.680644 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-2d5dfca1-058d-4ee2-a4bc-72edff934c48 req-67d275f6-595f-4220-b793-0220915d1306 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:07.681084 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-2d5dfca1-058d-4ee2-a4bc-72edff934c48 req-67d275f6-595f-4220-b793-0220915d1306 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:07.702681 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-2d5dfca1-058d-4ee2-a4bc-72edff934c48 req-67d275f6-595f-4220-b793-0220915d1306 service nova] Creating event network-changed:e09e7894-b521-40f8-ae1f-7364d6e573c9 for instance 1ad61db5-995d-47f1-a6d6-891628733252 on hv-cinder-81322 Oct 12 18:26:07.703297 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-2d5dfca1-058d-4ee2-a4bc-72edff934c48 req-67d275f6-595f-4220-b793-0220915d1306 service nova] Acquired lock "compute-rpcapi-router" {{(pid=109169) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 12 18:26:07.705096 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-43d9d42e-e2d7-4150-b59a-cbab1e21bcf2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:07.706063 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-43d9d42e-e2d7-4150-b59a-cbab1e21bcf2 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:07.707074 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-43d9d42e-e2d7-4150-b59a-cbab1e21bcf2 None None] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:07.707794 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-43d9d42e-e2d7-4150-b59a-cbab1e21bcf2 None None] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:07.718484 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.compute.rpcapi [None req-43d9d42e-e2d7-4150-b59a-cbab1e21bcf2 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 12 18:26:07.724820 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-bc4f4aea-c8dd-4e90-a5c9-de8b2d22e734 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:07.725668 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-43d9d42e-e2d7-4150-b59a-cbab1e21bcf2 None None] Releasing lock "compute-rpcapi-router" {{(pid=109169) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 12 18:26:07.740744 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-bc4f4aea-c8dd-4e90-a5c9-de8b2d22e734 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:07.747053 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-bc4f4aea-c8dd-4e90-a5c9-de8b2d22e734 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:07.750019 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-bc4f4aea-c8dd-4e90-a5c9-de8b2d22e734 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1406 microversion: 2.20 time: 0.452500 Oct 12 18:26:07.752980 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 47/91] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:26:07 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1406 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:26:07.763634 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-43d9d42e-e2d7-4150-b59a-cbab1e21bcf2 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.451692 Oct 12 18:26:07.766062 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 45/92] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:26:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:26:08.051930 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-51cde146-860f-4f61-98ed-75fbfd172ad9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:08.052794 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-51cde146-860f-4f61-98ed-75fbfd172ad9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:08.060238 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-51cde146-860f-4f61-98ed-75fbfd172ad9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:08.064761 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-51cde146-860f-4f61-98ed-75fbfd172ad9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:08.064761 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-51cde146-860f-4f61-98ed-75fbfd172ad9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:08.064761 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-51cde146-860f-4f61-98ed-75fbfd172ad9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:08.085449 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-6c6f5136-a24f-4dfe-badb-71eee4884041 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:08.091829 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-6c6f5136-a24f-4dfe-badb-71eee4884041 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:08.094739 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6c6f5136-a24f-4dfe-badb-71eee4884041 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:08.095457 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6c6f5136-a24f-4dfe-badb-71eee4884041 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:08.096532 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6c6f5136-a24f-4dfe-badb-71eee4884041 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:08.097365 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6c6f5136-a24f-4dfe-badb-71eee4884041 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:08.554710 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-51cde146-860f-4f61-98ed-75fbfd172ad9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:08.560230 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-6c6f5136-a24f-4dfe-badb-71eee4884041 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:08.570427 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-6c6f5136-a24f-4dfe-badb-71eee4884041 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1314 microversion: 2.1 time: 0.487504 Oct 12 18:26:08.571616 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 46/93] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:08 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:26:08.581651 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-fbc9a54b-06e6-4d01-a995-e7f1ce38dcb9 req-6a797785-db39-4f71-81a3-a1a808009bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a13e5623-9ecd-4036-b74a-48cbb84908de", "tag": "fabaeaf5-eee4-46bf-a4bf-984ef9955b1e"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:08.584841 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:26:08.584841 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:26:08.597000 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-fbc9a54b-06e6-4d01-a995-e7f1ce38dcb9 req-6a797785-db39-4f71-81a3-a1a808009bd5 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:08.601562 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-51cde146-860f-4f61-98ed-75fbfd172ad9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1363 microversion: 2.1 time: 0.557408 Oct 12 18:26:08.603106 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-fbc9a54b-06e6-4d01-a995-e7f1ce38dcb9 req-6a797785-db39-4f71-81a3-a1a808009bd5 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:08.612157 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 48/94] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:08 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1363 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:26:08.627566 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-fbc9a54b-06e6-4d01-a995-e7f1ce38dcb9 req-6a797785-db39-4f71-81a3-a1a808009bd5 service nova] Creating event network-changed:fabaeaf5-eee4-46bf-a4bf-984ef9955b1e for instance a13e5623-9ecd-4036-b74a-48cbb84908de on hv-cinder-81322 Oct 12 18:26:08.633785 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-fbc9a54b-06e6-4d01-a995-e7f1ce38dcb9 req-6a797785-db39-4f71-81a3-a1a808009bd5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060585 Oct 12 18:26:08.635284 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 47/95] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:26:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:26:08.774454 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-22fd4b1c-ff8f-4e0f-9c23-3c9281d9b626 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:08.777599 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-22fd4b1c-ff8f-4e0f-9c23-3c9281d9b626 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:08.802361 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-22fd4b1c-ff8f-4e0f-9c23-3c9281d9b626 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:08.803184 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-22fd4b1c-ff8f-4e0f-9c23-3c9281d9b626 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:08.806739 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-22fd4b1c-ff8f-4e0f-9c23-3c9281d9b626 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:08.807578 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-22fd4b1c-ff8f-4e0f-9c23-3c9281d9b626 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:09.119967 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-22fd4b1c-ff8f-4e0f-9c23-3c9281d9b626 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:09.129441 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-22fd4b1c-ff8f-4e0f-9c23-3c9281d9b626 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:09.131112 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-22fd4b1c-ff8f-4e0f-9c23-3c9281d9b626 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:09.132597 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-22fd4b1c-ff8f-4e0f-9c23-3c9281d9b626 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1406 microversion: 2.20 time: 0.365528 Oct 12 18:26:09.133090 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 49/96] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:26:08 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1406 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:26:09.591889 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-d5814a4e-1ae0-49e6-9063-284c4d940146 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:09.592918 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-d5814a4e-1ae0-49e6-9063-284c4d940146 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:09.606127 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d5814a4e-1ae0-49e6-9063-284c4d940146 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:09.607040 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d5814a4e-1ae0-49e6-9063-284c4d940146 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:09.608487 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d5814a4e-1ae0-49e6-9063-284c4d940146 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:09.609356 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d5814a4e-1ae0-49e6-9063-284c4d940146 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:09.629926 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3daf35cf-bdbf-4f08-8fa4-a38f56ca4311 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:09.631712 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3daf35cf-bdbf-4f08-8fa4-a38f56ca4311 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:09.646549 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3daf35cf-bdbf-4f08-8fa4-a38f56ca4311 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:09.646999 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3daf35cf-bdbf-4f08-8fa4-a38f56ca4311 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:09.649886 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3daf35cf-bdbf-4f08-8fa4-a38f56ca4311 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:09.654188 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3daf35cf-bdbf-4f08-8fa4-a38f56ca4311 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:09.925955 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-d5814a4e-1ae0-49e6-9063-284c4d940146 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:09.930087 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3daf35cf-bdbf-4f08-8fa4-a38f56ca4311 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:09.938106 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-d5814a4e-1ae0-49e6-9063-284c4d940146 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1314 microversion: 2.1 time: 0.348657 Oct 12 18:26:09.938106 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 48/97] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:09 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:26:09.942297 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3daf35cf-bdbf-4f08-8fa4-a38f56ca4311 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1363 microversion: 2.1 time: 0.318514 Oct 12 18:26:09.943244 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 50/98] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:09 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1363 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:26:10.152692 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-9d0d7240-4de1-4278-84bc-93132c5455d2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:10.153491 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-9d0d7240-4de1-4278-84bc-93132c5455d2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:10.162496 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9d0d7240-4de1-4278-84bc-93132c5455d2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:10.163958 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9d0d7240-4de1-4278-84bc-93132c5455d2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:10.165111 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9d0d7240-4de1-4278-84bc-93132c5455d2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:10.171390 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9d0d7240-4de1-4278-84bc-93132c5455d2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:10.367546 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-9d0d7240-4de1-4278-84bc-93132c5455d2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:10.376380 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-9d0d7240-4de1-4278-84bc-93132c5455d2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:10.381863 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-9d0d7240-4de1-4278-84bc-93132c5455d2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:10.383067 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-9d0d7240-4de1-4278-84bc-93132c5455d2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1406 microversion: 2.20 time: 0.235090 Oct 12 18:26:10.395838 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 49/99] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:26:10 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:26:10.958093 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c38ae097-c34f-4c24-974d-b76581fcad0a tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:10.960514 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c38ae097-c34f-4c24-974d-b76581fcad0a tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:10.962412 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c71b0603-c3b4-4ae2-9ef9-0f5ec1a5d6be tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:10.963503 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c71b0603-c3b4-4ae2-9ef9-0f5ec1a5d6be tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:10.973378 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c38ae097-c34f-4c24-974d-b76581fcad0a tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:10.973975 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c71b0603-c3b4-4ae2-9ef9-0f5ec1a5d6be tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:10.974136 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c38ae097-c34f-4c24-974d-b76581fcad0a tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:10.974611 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c71b0603-c3b4-4ae2-9ef9-0f5ec1a5d6be tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:10.975333 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c38ae097-c34f-4c24-974d-b76581fcad0a tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:10.975761 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c71b0603-c3b4-4ae2-9ef9-0f5ec1a5d6be tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:10.976146 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c38ae097-c34f-4c24-974d-b76581fcad0a tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:10.976316 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c71b0603-c3b4-4ae2-9ef9-0f5ec1a5d6be tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:11.298968 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c71b0603-c3b4-4ae2-9ef9-0f5ec1a5d6be tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:11.306308 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c71b0603-c3b4-4ae2-9ef9-0f5ec1a5d6be tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1363 microversion: 2.1 time: 0.349407 Oct 12 18:26:11.307578 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 50/100] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:10 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1363 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:26:11.362155 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c38ae097-c34f-4c24-974d-b76581fcad0a tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:11.374325 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c38ae097-c34f-4c24-974d-b76581fcad0a tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1314 microversion: 2.1 time: 0.426666 Oct 12 18:26:11.375577 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 51/101] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:10 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:26:11.402794 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-9c1038fb-ba11-45a4-ac7a-7d6b6965106a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:11.404014 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-9c1038fb-ba11-45a4-ac7a-7d6b6965106a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:11.423608 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9c1038fb-ba11-45a4-ac7a-7d6b6965106a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:11.426202 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9c1038fb-ba11-45a4-ac7a-7d6b6965106a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:11.434379 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9c1038fb-ba11-45a4-ac7a-7d6b6965106a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:11.435422 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9c1038fb-ba11-45a4-ac7a-7d6b6965106a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:11.662293 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-9c1038fb-ba11-45a4-ac7a-7d6b6965106a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:11.671178 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-9c1038fb-ba11-45a4-ac7a-7d6b6965106a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:11.690324 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-9c1038fb-ba11-45a4-ac7a-7d6b6965106a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:11.690324 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-9c1038fb-ba11-45a4-ac7a-7d6b6965106a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1406 microversion: 2.20 time: 0.275832 Oct 12 18:26:11.690324 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 51/102] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:26:11 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1406 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:26:12.323196 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-1758862d-b654-4b21-9cbd-dcba7d22697c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:12.324892 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-1758862d-b654-4b21-9cbd-dcba7d22697c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:12.331061 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1758862d-b654-4b21-9cbd-dcba7d22697c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:12.331508 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1758862d-b654-4b21-9cbd-dcba7d22697c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:12.332314 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1758862d-b654-4b21-9cbd-dcba7d22697c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:12.333053 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1758862d-b654-4b21-9cbd-dcba7d22697c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:12.485281 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-02114a0a-f7dc-4c8d-81cf-ad92df73ae59 req-0d68b2f9-5c54-47d2-817a-a7c808e0fdd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b41fbf9-05a2-46c9-b7a6-124028aa23ab", "name": "network-vif-plugged", "status": "completed", "tag": "b2fef676-0c4d-4948-82ee-4d56b09e2840"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:12.488063 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:26:12.488063 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:26:12.500189 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-02114a0a-f7dc-4c8d-81cf-ad92df73ae59 req-0d68b2f9-5c54-47d2-817a-a7c808e0fdd2 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:12.502420 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-02114a0a-f7dc-4c8d-81cf-ad92df73ae59 req-0d68b2f9-5c54-47d2-817a-a7c808e0fdd2 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:12.519015 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-02114a0a-f7dc-4c8d-81cf-ad92df73ae59 req-0d68b2f9-5c54-47d2-817a-a7c808e0fdd2 service nova] Creating event network-vif-plugged:b2fef676-0c4d-4948-82ee-4d56b09e2840 for instance 7b41fbf9-05a2-46c9-b7a6-124028aa23ab on hv-cinder-81322 Oct 12 18:26:12.526061 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-02114a0a-f7dc-4c8d-81cf-ad92df73ae59 req-0d68b2f9-5c54-47d2-817a-a7c808e0fdd2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.246033 Oct 12 18:26:12.527264 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 52/103] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:26:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:26:12.531874 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-1758862d-b654-4b21-9cbd-dcba7d22697c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:12.534543 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ba889d8a-64b7-4e5e-9d52-f0104ae0213e tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:12.535618 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ba889d8a-64b7-4e5e-9d52-f0104ae0213e tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:12.539835 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-1758862d-b654-4b21-9cbd-dcba7d22697c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1363 microversion: 2.1 time: 0.220561 Oct 12 18:26:12.540739 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 52/104] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:12 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:26:12.543930 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ba889d8a-64b7-4e5e-9d52-f0104ae0213e tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:12.544906 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ba889d8a-64b7-4e5e-9d52-f0104ae0213e tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:12.545941 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ba889d8a-64b7-4e5e-9d52-f0104ae0213e tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:12.546590 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ba889d8a-64b7-4e5e-9d52-f0104ae0213e tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:12.701484 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-54d1943b-3199-4761-b701-c7877045ad86 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:12.703449 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-54d1943b-3199-4761-b701-c7877045ad86 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:12.710923 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-54d1943b-3199-4761-b701-c7877045ad86 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:12.711075 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-54d1943b-3199-4761-b701-c7877045ad86 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:12.714785 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-54d1943b-3199-4761-b701-c7877045ad86 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:12.715233 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-54d1943b-3199-4761-b701-c7877045ad86 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:12.732904 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ba889d8a-64b7-4e5e-9d52-f0104ae0213e tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:12.745171 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ba889d8a-64b7-4e5e-9d52-f0104ae0213e tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1314 microversion: 2.1 time: 0.211823 Oct 12 18:26:12.756428 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 53/105] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:12 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:26:12.901062 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-54d1943b-3199-4761-b701-c7877045ad86 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:12.910747 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-54d1943b-3199-4761-b701-c7877045ad86 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:12.913412 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-54d1943b-3199-4761-b701-c7877045ad86 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:12.926865 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-54d1943b-3199-4761-b701-c7877045ad86 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1406 microversion: 2.20 time: 0.217467 Oct 12 18:26:12.928853 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 53/106] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:26:12 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:26:13.556296 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-23d8b93d-4bb4-4793-bc9c-b455ead383f9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:13.556859 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-23d8b93d-4bb4-4793-bc9c-b455ead383f9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:13.564204 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-23d8b93d-4bb4-4793-bc9c-b455ead383f9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:13.564204 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-23d8b93d-4bb4-4793-bc9c-b455ead383f9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:13.564963 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-23d8b93d-4bb4-4793-bc9c-b455ead383f9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:13.565419 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-23d8b93d-4bb4-4793-bc9c-b455ead383f9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:13.757686 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-23d8b93d-4bb4-4793-bc9c-b455ead383f9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:13.766271 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-65e1e468-d3db-41c6-bdb8-4a000c02b7ea tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:13.766271 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-65e1e468-d3db-41c6-bdb8-4a000c02b7ea tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:13.768714 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-23d8b93d-4bb4-4793-bc9c-b455ead383f9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1363 microversion: 2.1 time: 0.214122 Oct 12 18:26:13.771289 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 54/107] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:13 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:26:13.772085 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-65e1e468-d3db-41c6-bdb8-4a000c02b7ea tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:13.776514 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-65e1e468-d3db-41c6-bdb8-4a000c02b7ea tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:13.777368 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-65e1e468-d3db-41c6-bdb8-4a000c02b7ea tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:13.777803 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-65e1e468-d3db-41c6-bdb8-4a000c02b7ea tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:13.934325 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-55165483-aad9-4b17-a084-3e0612eb81e0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:13.935050 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-55165483-aad9-4b17-a084-3e0612eb81e0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:13.944252 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-55165483-aad9-4b17-a084-3e0612eb81e0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:13.944882 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-55165483-aad9-4b17-a084-3e0612eb81e0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:13.953243 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-65e1e468-d3db-41c6-bdb8-4a000c02b7ea tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:13.956610 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-55165483-aad9-4b17-a084-3e0612eb81e0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:13.957287 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-55165483-aad9-4b17-a084-3e0612eb81e0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:13.961778 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-65e1e468-d3db-41c6-bdb8-4a000c02b7ea tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1314 microversion: 2.1 time: 0.202637 Oct 12 18:26:13.973584 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 54/108] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:13 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:26:14.109483 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-55165483-aad9-4b17-a084-3e0612eb81e0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:14.120221 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-55165483-aad9-4b17-a084-3e0612eb81e0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:14.121883 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-55165483-aad9-4b17-a084-3e0612eb81e0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:14.123029 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-55165483-aad9-4b17-a084-3e0612eb81e0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1406 microversion: 2.20 time: 0.193699 Oct 12 18:26:14.123631 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 55/109] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:26:13 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:26:14.786769 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-6e7f2567-3ae1-4af2-ad48-d625cf65a6d4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:14.787658 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-6e7f2567-3ae1-4af2-ad48-d625cf65a6d4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:14.794401 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6e7f2567-3ae1-4af2-ad48-d625cf65a6d4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:14.798785 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6e7f2567-3ae1-4af2-ad48-d625cf65a6d4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:14.798785 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6e7f2567-3ae1-4af2-ad48-d625cf65a6d4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:14.798785 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6e7f2567-3ae1-4af2-ad48-d625cf65a6d4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:14.951723 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-6e7f2567-3ae1-4af2-ad48-d625cf65a6d4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:14.959618 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-6e7f2567-3ae1-4af2-ad48-d625cf65a6d4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1363 microversion: 2.1 time: 0.176577 Oct 12 18:26:14.960187 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 55/110] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:14 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:26:14.981361 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e6610d77-d2d8-4761-b5fd-bfe163d6f397 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:14.984094 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e6610d77-d2d8-4761-b5fd-bfe163d6f397 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:14.990911 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e6610d77-d2d8-4761-b5fd-bfe163d6f397 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:14.991879 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e6610d77-d2d8-4761-b5fd-bfe163d6f397 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:14.993142 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e6610d77-d2d8-4761-b5fd-bfe163d6f397 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:14.993566 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e6610d77-d2d8-4761-b5fd-bfe163d6f397 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:15.127558 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e6610d77-d2d8-4761-b5fd-bfe163d6f397 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:15.134922 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e6610d77-d2d8-4761-b5fd-bfe163d6f397 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1314 microversion: 2.1 time: 0.157439 Oct 12 18:26:15.135527 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 56/111] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:14 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:26:15.145227 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-49aacd9f-9c27-46cc-a04a-ac536ae93cd0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:15.145227 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-49aacd9f-9c27-46cc-a04a-ac536ae93cd0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:15.150029 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-49aacd9f-9c27-46cc-a04a-ac536ae93cd0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:15.150480 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-49aacd9f-9c27-46cc-a04a-ac536ae93cd0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:15.158780 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-49aacd9f-9c27-46cc-a04a-ac536ae93cd0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:15.158780 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-49aacd9f-9c27-46cc-a04a-ac536ae93cd0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:15.310541 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-49aacd9f-9c27-46cc-a04a-ac536ae93cd0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:15.322399 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-49aacd9f-9c27-46cc-a04a-ac536ae93cd0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:15.324024 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-49aacd9f-9c27-46cc-a04a-ac536ae93cd0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:15.325288 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-49aacd9f-9c27-46cc-a04a-ac536ae93cd0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1406 microversion: 2.20 time: 0.187527 Oct 12 18:26:15.342485 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 56/112] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:26:15 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:26:15.576993 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-9c39251d-5a32-457b-b162-06908e1dbee7 req-9338030c-68ad-488a-bef3-a84450424e50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ad61db5-995d-47f1-a6d6-891628733252", "name": "network-vif-plugged", "status": "completed", "tag": "e09e7894-b521-40f8-ae1f-7364d6e573c9"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:15.581611 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:26:15.581611 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:26:15.586370 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-9c39251d-5a32-457b-b162-06908e1dbee7 req-9338030c-68ad-488a-bef3-a84450424e50 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:15.586828 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-9c39251d-5a32-457b-b162-06908e1dbee7 req-9338030c-68ad-488a-bef3-a84450424e50 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:15.598002 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-9c39251d-5a32-457b-b162-06908e1dbee7 req-9338030c-68ad-488a-bef3-a84450424e50 service nova] Creating event network-vif-plugged:e09e7894-b521-40f8-ae1f-7364d6e573c9 for instance 1ad61db5-995d-47f1-a6d6-891628733252 on hv-cinder-81322 Oct 12 18:26:15.603315 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-9c39251d-5a32-457b-b162-06908e1dbee7 req-9338030c-68ad-488a-bef3-a84450424e50 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032903 Oct 12 18:26:15.604009 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 57/113] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:26:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:26:15.976990 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-360e6fcb-28f6-4e2c-abc8-0f8d1ed4aeca tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:15.977607 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-360e6fcb-28f6-4e2c-abc8-0f8d1ed4aeca tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:15.983535 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-360e6fcb-28f6-4e2c-abc8-0f8d1ed4aeca tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:15.983987 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-360e6fcb-28f6-4e2c-abc8-0f8d1ed4aeca tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:15.984791 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-360e6fcb-28f6-4e2c-abc8-0f8d1ed4aeca tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:15.985225 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-360e6fcb-28f6-4e2c-abc8-0f8d1ed4aeca tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:16.151848 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-fe77d32f-ce49-49b2-9193-83a44c9c21fb tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:16.152932 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-fe77d32f-ce49-49b2-9193-83a44c9c21fb tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:16.164991 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fe77d32f-ce49-49b2-9193-83a44c9c21fb tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:16.165830 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fe77d32f-ce49-49b2-9193-83a44c9c21fb tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:16.166918 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-360e6fcb-28f6-4e2c-abc8-0f8d1ed4aeca tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:16.167676 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fe77d32f-ce49-49b2-9193-83a44c9c21fb tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:16.169421 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fe77d32f-ce49-49b2-9193-83a44c9c21fb tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:16.176232 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-360e6fcb-28f6-4e2c-abc8-0f8d1ed4aeca tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1363 microversion: 2.1 time: 0.202885 Oct 12 18:26:16.178643 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 57/114] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:15 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:26:16.350894 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-03a54af4-5a9c-436f-b4d5-ae97eab8f10f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:16.351881 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-03a54af4-5a9c-436f-b4d5-ae97eab8f10f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:16.353847 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-fe77d32f-ce49-49b2-9193-83a44c9c21fb tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:16.361774 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-03a54af4-5a9c-436f-b4d5-ae97eab8f10f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:16.363744 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-03a54af4-5a9c-436f-b4d5-ae97eab8f10f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:16.363744 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-03a54af4-5a9c-436f-b4d5-ae97eab8f10f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:16.363744 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-03a54af4-5a9c-436f-b4d5-ae97eab8f10f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:16.366298 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-fe77d32f-ce49-49b2-9193-83a44c9c21fb tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1501 microversion: 2.1 time: 0.218901 Oct 12 18:26:16.367084 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 58/115] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:16 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1501 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:26:16.509701 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-03a54af4-5a9c-436f-b4d5-ae97eab8f10f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:16.520119 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-03a54af4-5a9c-436f-b4d5-ae97eab8f10f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:16.522074 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-03a54af4-5a9c-436f-b4d5-ae97eab8f10f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:16.523537 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-03a54af4-5a9c-436f-b4d5-ae97eab8f10f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1406 microversion: 2.20 time: 0.176969 Oct 12 18:26:16.524098 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 58/116] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:26:16 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:26:17.194972 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2f3816e6-3047-4c45-86cb-b4a12a26cce4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:17.195619 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2f3816e6-3047-4c45-86cb-b4a12a26cce4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:17.201318 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2f3816e6-3047-4c45-86cb-b4a12a26cce4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:17.201756 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2f3816e6-3047-4c45-86cb-b4a12a26cce4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:17.202506 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2f3816e6-3047-4c45-86cb-b4a12a26cce4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:17.202932 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2f3816e6-3047-4c45-86cb-b4a12a26cce4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:17.378774 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2f3816e6-3047-4c45-86cb-b4a12a26cce4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:17.385807 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2f3816e6-3047-4c45-86cb-b4a12a26cce4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1363 microversion: 2.1 time: 0.194737 Oct 12 18:26:17.386391 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 59/117] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:17 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:26:17.540851 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-092f2bec-f817-46d7-bf2a-ff7a3c116a01 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:17.541463 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-092f2bec-f817-46d7-bf2a-ff7a3c116a01 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:17.547296 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-092f2bec-f817-46d7-bf2a-ff7a3c116a01 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:17.547747 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-092f2bec-f817-46d7-bf2a-ff7a3c116a01 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:17.548618 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-092f2bec-f817-46d7-bf2a-ff7a3c116a01 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:17.549051 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-092f2bec-f817-46d7-bf2a-ff7a3c116a01 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:17.619685 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-f2e75f3c-f4a2-4107-b2d7-5b2a395d2ffc req-63eb3bf2-b827-4bf0-aa38-6094ec1858dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a13e5623-9ecd-4036-b74a-48cbb84908de", "name": "network-vif-plugged", "status": "completed", "tag": "fabaeaf5-eee4-46bf-a4bf-984ef9955b1e"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:17.620742 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:26:17.620742 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:26:17.628648 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-f2e75f3c-f4a2-4107-b2d7-5b2a395d2ffc req-63eb3bf2-b827-4bf0-aa38-6094ec1858dd service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:17.629605 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-f2e75f3c-f4a2-4107-b2d7-5b2a395d2ffc req-63eb3bf2-b827-4bf0-aa38-6094ec1858dd service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:17.641142 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-f2e75f3c-f4a2-4107-b2d7-5b2a395d2ffc req-63eb3bf2-b827-4bf0-aa38-6094ec1858dd service nova] Creating event network-vif-plugged:fabaeaf5-eee4-46bf-a4bf-984ef9955b1e for instance a13e5623-9ecd-4036-b74a-48cbb84908de on hv-cinder-81322 Oct 12 18:26:17.647811 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-f2e75f3c-f4a2-4107-b2d7-5b2a395d2ffc req-63eb3bf2-b827-4bf0-aa38-6094ec1858dd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031333 Oct 12 18:26:17.648431 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 60/118] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:26:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 18:26:17.692709 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-092f2bec-f817-46d7-bf2a-ff7a3c116a01 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:17.700714 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-092f2bec-f817-46d7-bf2a-ff7a3c116a01 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:17.702421 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-092f2bec-f817-46d7-bf2a-ff7a3c116a01 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:17.703731 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-092f2bec-f817-46d7-bf2a-ff7a3c116a01 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1406 microversion: 2.20 time: 0.166596 Oct 12 18:26:17.704606 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 59/119] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:26:17 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:26:18.404612 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8145f652-cf56-4477-859e-af369f216bbe tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:18.405420 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8145f652-cf56-4477-859e-af369f216bbe tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:18.412190 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8145f652-cf56-4477-859e-af369f216bbe tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:18.413178 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8145f652-cf56-4477-859e-af369f216bbe tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:18.414623 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8145f652-cf56-4477-859e-af369f216bbe tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:18.415227 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8145f652-cf56-4477-859e-af369f216bbe tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:18.666504 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8145f652-cf56-4477-859e-af369f216bbe tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:18.674046 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8145f652-cf56-4477-859e-af369f216bbe tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1549 microversion: 2.1 time: 0.273854 Oct 12 18:26:18.688544 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 61/120] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:18 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1549 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:26:18.711267 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c1d92c19-aae5-4685-9df0-ae3eb2df805e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:18.719570 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c1d92c19-aae5-4685-9df0-ae3eb2df805e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:18.719570 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c1d92c19-aae5-4685-9df0-ae3eb2df805e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:18.720519 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c1d92c19-aae5-4685-9df0-ae3eb2df805e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:18.721506 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c1d92c19-aae5-4685-9df0-ae3eb2df805e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:18.722130 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c1d92c19-aae5-4685-9df0-ae3eb2df805e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:18.734839 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-6448d53f-0d1f-4062-a420-8133ef34961d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:18.738722 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-6448d53f-0d1f-4062-a420-8133ef34961d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:18.764710 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6448d53f-0d1f-4062-a420-8133ef34961d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:18.765584 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6448d53f-0d1f-4062-a420-8133ef34961d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:18.766535 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6448d53f-0d1f-4062-a420-8133ef34961d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:18.767205 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6448d53f-0d1f-4062-a420-8133ef34961d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:18.882069 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c1d92c19-aae5-4685-9df0-ae3eb2df805e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.181447 Oct 12 18:26:18.883879 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 60/121] 10.222.0.18 () {58 vars in 1274 bytes} [Tue Oct 12 18:26:18 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/os-interface => generated 284 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:26:18.960719 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-6448d53f-0d1f-4062-a420-8133ef34961d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:18.968817 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-6448d53f-0d1f-4062-a420-8133ef34961d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:18.970552 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-6448d53f-0d1f-4062-a420-8133ef34961d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:18.971782 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-6448d53f-0d1f-4062-a420-8133ef34961d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1406 microversion: 2.20 time: 0.252801 Oct 12 18:26:18.976921 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 62/122] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:26:18 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1406 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:26:19.657992 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-778ae9cd-8df4-4d4a-b2cd-5a222de326ca tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0fc18201-5028-4707-abd1-f0e17dd1f96d"}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:19.659204 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-778ae9cd-8df4-4d4a-b2cd-5a222de326ca tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:19.666766 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-778ae9cd-8df4-4d4a-b2cd-5a222de326ca tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:19.667401 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-778ae9cd-8df4-4d4a-b2cd-5a222de326ca tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:19.668353 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-778ae9cd-8df4-4d4a-b2cd-5a222de326ca tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:19.668931 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-778ae9cd-8df4-4d4a-b2cd-5a222de326ca tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:19.990100 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-163da46e-7b00-424c-afe4-993577805670 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:19.990703 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-163da46e-7b00-424c-afe4-993577805670 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:19.996612 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-163da46e-7b00-424c-afe4-993577805670 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:19.997050 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-163da46e-7b00-424c-afe4-993577805670 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:19.997794 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-163da46e-7b00-424c-afe4-993577805670 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:19.998216 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-163da46e-7b00-424c-afe4-993577805670 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:20.116892 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-163da46e-7b00-424c-afe4-993577805670 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:20.124851 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-163da46e-7b00-424c-afe4-993577805670 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:20.126340 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-163da46e-7b00-424c-afe4-993577805670 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:20.127430 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-163da46e-7b00-424c-afe4-993577805670 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1406 microversion: 2.20 time: 0.141633 Oct 12 18:26:20.127977 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 63/123] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:26:19 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1406 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:26:21.147895 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-cd8be0b4-b9f3-49d9-8434-ce1a9dc1e9c6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:21.149217 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-cd8be0b4-b9f3-49d9-8434-ce1a9dc1e9c6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:21.155525 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cd8be0b4-b9f3-49d9-8434-ce1a9dc1e9c6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:21.155976 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cd8be0b4-b9f3-49d9-8434-ce1a9dc1e9c6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:21.156802 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cd8be0b4-b9f3-49d9-8434-ce1a9dc1e9c6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:21.157337 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cd8be0b4-b9f3-49d9-8434-ce1a9dc1e9c6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:21.285898 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-cd8be0b4-b9f3-49d9-8434-ce1a9dc1e9c6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:21.297381 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-cd8be0b4-b9f3-49d9-8434-ce1a9dc1e9c6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:21.301589 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-cd8be0b4-b9f3-49d9-8434-ce1a9dc1e9c6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:21.302704 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-cd8be0b4-b9f3-49d9-8434-ce1a9dc1e9c6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1406 microversion: 2.20 time: 0.160368 Oct 12 18:26:21.303260 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 64/124] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:26:21 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:26:21.324817 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-83b74071-feac-49ac-b48b-df6db71dcc80 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:21.326111 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-83b74071-feac-49ac-b48b-df6db71dcc80 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:21.333319 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-83b74071-feac-49ac-b48b-df6db71dcc80 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:21.334032 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-83b74071-feac-49ac-b48b-df6db71dcc80 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:21.334971 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-83b74071-feac-49ac-b48b-df6db71dcc80 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:21.335575 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-83b74071-feac-49ac-b48b-df6db71dcc80 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:24.522209 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-83b74071-feac-49ac-b48b-df6db71dcc80 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 14 microversion: 2.1 time: 3.212139 Oct 12 18:26:24.522209 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 65/125] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:26:21 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 14 bytes in 3214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 18:26:24.526862 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-73219bfe-290b-4378-ad65-7a896ee98f1e req-ef9624cc-667c-437f-9620-4da2f274511c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ad61db5-995d-47f1-a6d6-891628733252", "tag": "e09e7894-b521-40f8-ae1f-7364d6e573c9"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:24.528817 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:26:24.528817 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:26:24.535698 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-73219bfe-290b-4378-ad65-7a896ee98f1e req-ef9624cc-667c-437f-9620-4da2f274511c service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:24.536193 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-73219bfe-290b-4378-ad65-7a896ee98f1e req-ef9624cc-667c-437f-9620-4da2f274511c service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:24.546135 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-73219bfe-290b-4378-ad65-7a896ee98f1e req-ef9624cc-667c-437f-9620-4da2f274511c service nova] Creating event network-changed:e09e7894-b521-40f8-ae1f-7364d6e573c9 for instance 1ad61db5-995d-47f1-a6d6-891628733252 on hv-cinder-81322 Oct 12 18:26:24.550833 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-73219bfe-290b-4378-ad65-7a896ee98f1e req-ef9624cc-667c-437f-9620-4da2f274511c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028481 Oct 12 18:26:24.554116 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 66/126] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:26:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:26:24.556229 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ec586d4a-bd61-44f2-a79c-1da554afa939 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:24.556940 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ec586d4a-bd61-44f2-a79c-1da554afa939 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:24.562609 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ec586d4a-bd61-44f2-a79c-1da554afa939 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:24.563057 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ec586d4a-bd61-44f2-a79c-1da554afa939 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:24.563810 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ec586d4a-bd61-44f2-a79c-1da554afa939 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:24.564240 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ec586d4a-bd61-44f2-a79c-1da554afa939 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:24.686628 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ec586d4a-bd61-44f2-a79c-1da554afa939 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:24.694932 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ec586d4a-bd61-44f2-a79c-1da554afa939 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:24.696447 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ec586d4a-bd61-44f2-a79c-1da554afa939 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:24.697555 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ec586d4a-bd61-44f2-a79c-1da554afa939 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1406 microversion: 2.20 time: 0.145087 Oct 12 18:26:24.698112 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 67/127] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:26:24 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1406 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:26:25.533138 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-864c733e-13ef-4671-b36d-df0cd21cc593 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:25.537790 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-778ae9cd-8df4-4d4a-b2cd-5a222de326ca tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "POST /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.883078 Oct 12 18:26:25.539088 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-864c733e-13ef-4671-b36d-df0cd21cc593 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:25.540864 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 61/128] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Oct 12 18:26:19 2021] POST /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab/os-volume_attachments => generated 194 bytes in 5886 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:26:25.549508 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-864c733e-13ef-4671-b36d-df0cd21cc593 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:25.551414 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-864c733e-13ef-4671-b36d-df0cd21cc593 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:25.553484 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-864c733e-13ef-4671-b36d-df0cd21cc593 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:25.554883 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-864c733e-13ef-4671-b36d-df0cd21cc593 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:25.716740 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-21c6cc51-412b-4063-a2f4-06adaa03ebe8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:25.717514 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-21c6cc51-412b-4063-a2f4-06adaa03ebe8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:25.724246 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-21c6cc51-412b-4063-a2f4-06adaa03ebe8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:25.724790 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-21c6cc51-412b-4063-a2f4-06adaa03ebe8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:25.725633 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-21c6cc51-412b-4063-a2f4-06adaa03ebe8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:25.726067 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-21c6cc51-412b-4063-a2f4-06adaa03ebe8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:25.758734 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-864c733e-13ef-4671-b36d-df0cd21cc593 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 14 microversion: 2.1 time: 0.230455 Oct 12 18:26:25.759648 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 68/129] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:26:25 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 14 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 18:26:25.872505 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-21c6cc51-412b-4063-a2f4-06adaa03ebe8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:25.881444 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-21c6cc51-412b-4063-a2f4-06adaa03ebe8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:25.883129 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-21c6cc51-412b-4063-a2f4-06adaa03ebe8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:25.884271 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-21c6cc51-412b-4063-a2f4-06adaa03ebe8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1406 microversion: 2.20 time: 0.171674 Oct 12 18:26:25.884860 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 62/130] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:26:25 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:26:26.770460 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-6be48e72-64e1-470f-93cf-48d725d4e1ad tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:26.771501 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-6be48e72-64e1-470f-93cf-48d725d4e1ad tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:26.778943 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6be48e72-64e1-470f-93cf-48d725d4e1ad tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:26.779483 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6be48e72-64e1-470f-93cf-48d725d4e1ad tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:26.780274 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6be48e72-64e1-470f-93cf-48d725d4e1ad tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:26.780744 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6be48e72-64e1-470f-93cf-48d725d4e1ad tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:26.858743 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-6be48e72-64e1-470f-93cf-48d725d4e1ad tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 14 microversion: 2.1 time: 0.092163 Oct 12 18:26:26.859379 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 69/131] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:26:26 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 18:26:26.902315 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-94aa7614-0e38-4218-8445-3dde48162c3a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:26.902914 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-94aa7614-0e38-4218-8445-3dde48162c3a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:26.908684 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-94aa7614-0e38-4218-8445-3dde48162c3a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:26.909132 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-94aa7614-0e38-4218-8445-3dde48162c3a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:26.910526 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-94aa7614-0e38-4218-8445-3dde48162c3a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:26.910952 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-94aa7614-0e38-4218-8445-3dde48162c3a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:27.040453 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-94aa7614-0e38-4218-8445-3dde48162c3a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:27.048208 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-94aa7614-0e38-4218-8445-3dde48162c3a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:27.049667 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-94aa7614-0e38-4218-8445-3dde48162c3a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:27.050838 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-94aa7614-0e38-4218-8445-3dde48162c3a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1599 microversion: 2.20 time: 0.152436 Oct 12 18:26:27.051400 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 63/132] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:26:26 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:26:27.068946 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d3f31390-47b9-4c27-b2a9-70fde4f1330d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:27.069521 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d3f31390-47b9-4c27-b2a9-70fde4f1330d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:27.076175 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d3f31390-47b9-4c27-b2a9-70fde4f1330d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:27.076658 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d3f31390-47b9-4c27-b2a9-70fde4f1330d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:27.082620 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d3f31390-47b9-4c27-b2a9-70fde4f1330d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:27.082620 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d3f31390-47b9-4c27-b2a9-70fde4f1330d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:27.170664 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d3f31390-47b9-4c27-b2a9-70fde4f1330d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.105729 Oct 12 18:26:27.171257 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 70/133] 10.222.0.18 () {60 vars in 1315 bytes} [Tue Oct 12 18:26:27 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:26:27.869720 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-98386a8d-33ad-417d-93b0-a332dced3e3f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:27.871096 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-98386a8d-33ad-417d-93b0-a332dced3e3f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:27.877902 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-98386a8d-33ad-417d-93b0-a332dced3e3f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:27.879067 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-98386a8d-33ad-417d-93b0-a332dced3e3f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:27.879846 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-98386a8d-33ad-417d-93b0-a332dced3e3f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:27.880268 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-98386a8d-33ad-417d-93b0-a332dced3e3f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:27.952949 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-98386a8d-33ad-417d-93b0-a332dced3e3f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 14 microversion: 2.1 time: 0.086195 Oct 12 18:26:27.955303 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 64/134] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:26:27 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 18:26:28.740228 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ac88fc91-541a-4883-9678-0286ae2b44ce tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:28.745804 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ac88fc91-541a-4883-9678-0286ae2b44ce tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:28.746051 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-2f7d576d-3984-4179-9bd8-b7b96c546715 req-d1229397-d7e9-4bb4-985d-25e87d390c08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a13e5623-9ecd-4036-b74a-48cbb84908de", "tag": "fabaeaf5-eee4-46bf-a4bf-984ef9955b1e"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:28.746051 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:26:28.746051 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:26:28.749002 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ac88fc91-541a-4883-9678-0286ae2b44ce tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:28.749454 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ac88fc91-541a-4883-9678-0286ae2b44ce tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:28.750388 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ac88fc91-541a-4883-9678-0286ae2b44ce tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:28.750813 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ac88fc91-541a-4883-9678-0286ae2b44ce tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:28.754005 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-2f7d576d-3984-4179-9bd8-b7b96c546715 req-d1229397-d7e9-4bb4-985d-25e87d390c08 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:28.754705 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-2f7d576d-3984-4179-9bd8-b7b96c546715 req-d1229397-d7e9-4bb4-985d-25e87d390c08 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:28.766727 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-2f7d576d-3984-4179-9bd8-b7b96c546715 req-d1229397-d7e9-4bb4-985d-25e87d390c08 service nova] Creating event network-changed:fabaeaf5-eee4-46bf-a4bf-984ef9955b1e for instance a13e5623-9ecd-4036-b74a-48cbb84908de on hv-cinder-81322 Oct 12 18:26:28.772246 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-2f7d576d-3984-4179-9bd8-b7b96c546715 req-d1229397-d7e9-4bb4-985d-25e87d390c08 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032470 Oct 12 18:26:28.773361 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 65/135] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:26:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:26:28.835341 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ac88fc91-541a-4883-9678-0286ae2b44ce tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 14 microversion: 2.20 time: 0.098789 Oct 12 18:26:28.836284 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 71/136] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:26:28 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:26:28.968214 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-28635fa7-697b-4115-81e9-626fc5873a5d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:28.970175 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-28635fa7-697b-4115-81e9-626fc5873a5d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:28.985940 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-28635fa7-697b-4115-81e9-626fc5873a5d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:28.986550 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-28635fa7-697b-4115-81e9-626fc5873a5d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:28.987547 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-28635fa7-697b-4115-81e9-626fc5873a5d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:28.988152 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-28635fa7-697b-4115-81e9-626fc5873a5d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:29.078232 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-28635fa7-697b-4115-81e9-626fc5873a5d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 14 microversion: 2.1 time: 0.114192 Oct 12 18:26:29.079352 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 66/137] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:26:28 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 18:26:29.847443 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d173b2d0-a049-4b76-8b58-02bb7cfeefa6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:29.848468 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d173b2d0-a049-4b76-8b58-02bb7cfeefa6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:29.858754 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d173b2d0-a049-4b76-8b58-02bb7cfeefa6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:29.859455 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d173b2d0-a049-4b76-8b58-02bb7cfeefa6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:29.860524 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d173b2d0-a049-4b76-8b58-02bb7cfeefa6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:29.860980 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d173b2d0-a049-4b76-8b58-02bb7cfeefa6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:29.934524 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d173b2d0-a049-4b76-8b58-02bb7cfeefa6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 14 microversion: 2.20 time: 0.091297 Oct 12 18:26:29.937688 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 72/138] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:26:29 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:26:30.091432 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-e8fe2ad2-2cc9-4045-815c-4fe66a26b986 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:30.093542 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-e8fe2ad2-2cc9-4045-815c-4fe66a26b986 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:30.105326 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e8fe2ad2-2cc9-4045-815c-4fe66a26b986 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:30.106332 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e8fe2ad2-2cc9-4045-815c-4fe66a26b986 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:30.107981 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e8fe2ad2-2cc9-4045-815c-4fe66a26b986 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:30.109181 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e8fe2ad2-2cc9-4045-815c-4fe66a26b986 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:30.223532 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-e8fe2ad2-2cc9-4045-815c-4fe66a26b986 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 14 microversion: 2.1 time: 0.136813 Oct 12 18:26:30.229211 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 67/139] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:26:30 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 18:26:30.946856 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-18fc11d4-1fc2-45e6-921f-4fab258cfec3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:30.952215 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-18fc11d4-1fc2-45e6-921f-4fab258cfec3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:30.960425 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-18fc11d4-1fc2-45e6-921f-4fab258cfec3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:30.961143 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-18fc11d4-1fc2-45e6-921f-4fab258cfec3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:30.962544 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-18fc11d4-1fc2-45e6-921f-4fab258cfec3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:30.963586 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-18fc11d4-1fc2-45e6-921f-4fab258cfec3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:31.048727 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-18fc11d4-1fc2-45e6-921f-4fab258cfec3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 14 microversion: 2.20 time: 0.106012 Oct 12 18:26:31.049608 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 73/140] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:26:30 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:26:31.241807 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-f6b4f923-98a4-48fc-a8ce-727b03ff51a7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:31.242813 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-f6b4f923-98a4-48fc-a8ce-727b03ff51a7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:31.258363 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f6b4f923-98a4-48fc-a8ce-727b03ff51a7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:31.262677 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f6b4f923-98a4-48fc-a8ce-727b03ff51a7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:31.262677 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f6b4f923-98a4-48fc-a8ce-727b03ff51a7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:31.262677 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f6b4f923-98a4-48fc-a8ce-727b03ff51a7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:31.349545 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-f6b4f923-98a4-48fc-a8ce-727b03ff51a7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 14 microversion: 2.1 time: 0.112241 Oct 12 18:26:31.350275 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 68/141] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:26:31 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 18:26:32.063100 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a5b0d78f-86a8-4857-b7fa-b1d8aa71c0d6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:32.064876 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a5b0d78f-86a8-4857-b7fa-b1d8aa71c0d6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:32.075940 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a5b0d78f-86a8-4857-b7fa-b1d8aa71c0d6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:32.076393 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a5b0d78f-86a8-4857-b7fa-b1d8aa71c0d6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:32.077380 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a5b0d78f-86a8-4857-b7fa-b1d8aa71c0d6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:32.077816 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a5b0d78f-86a8-4857-b7fa-b1d8aa71c0d6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:32.174768 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a5b0d78f-86a8-4857-b7fa-b1d8aa71c0d6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 14 microversion: 2.20 time: 0.112655 Oct 12 18:26:32.174768 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 74/142] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:26:32 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:26:32.361264 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-0144252f-5a07-4caf-b0a7-4383092f1590 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:32.363148 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-0144252f-5a07-4caf-b0a7-4383092f1590 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:32.370168 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0144252f-5a07-4caf-b0a7-4383092f1590 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:32.374530 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0144252f-5a07-4caf-b0a7-4383092f1590 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:32.375933 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0144252f-5a07-4caf-b0a7-4383092f1590 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:32.376632 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0144252f-5a07-4caf-b0a7-4383092f1590 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:32.487228 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-0144252f-5a07-4caf-b0a7-4383092f1590 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 6451 microversion: 2.1 time: 0.129905 Oct 12 18:26:32.491459 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 69/143] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:26:32 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 6451 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:26:33.183407 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4145f7b0-83c0-4ed4-8544-94f6f68acab3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:33.184812 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4145f7b0-83c0-4ed4-8544-94f6f68acab3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:33.195286 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4145f7b0-83c0-4ed4-8544-94f6f68acab3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:33.200525 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4145f7b0-83c0-4ed4-8544-94f6f68acab3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:33.207903 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4145f7b0-83c0-4ed4-8544-94f6f68acab3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:33.208349 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4145f7b0-83c0-4ed4-8544-94f6f68acab3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:33.499173 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-f7dd6261-022b-4a8c-a013-87a04580b1d3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:33.500161 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-f7dd6261-022b-4a8c-a013-87a04580b1d3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:33.507180 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f7dd6261-022b-4a8c-a013-87a04580b1d3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:33.507623 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f7dd6261-022b-4a8c-a013-87a04580b1d3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:33.508174 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4145f7b0-83c0-4ed4-8544-94f6f68acab3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 14 microversion: 2.20 time: 0.329276 Oct 12 18:26:33.508391 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f7dd6261-022b-4a8c-a013-87a04580b1d3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:33.508857 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f7dd6261-022b-4a8c-a013-87a04580b1d3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:33.509072 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 75/144] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:26:33 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 14 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:26:33.674260 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-f7dd6261-022b-4a8c-a013-87a04580b1d3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 11371 microversion: 2.1 time: 0.178578 Oct 12 18:26:33.675975 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 70/145] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:26:33 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 11371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:26:34.521967 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-28d0720c-3543-427c-bc06-b226f10144e2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:34.524257 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-28d0720c-3543-427c-bc06-b226f10144e2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:34.531382 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-28d0720c-3543-427c-bc06-b226f10144e2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:34.531831 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-28d0720c-3543-427c-bc06-b226f10144e2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:34.532636 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-28d0720c-3543-427c-bc06-b226f10144e2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:34.533067 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-28d0720c-3543-427c-bc06-b226f10144e2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:34.631923 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-28d0720c-3543-427c-bc06-b226f10144e2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 14 microversion: 2.20 time: 0.116058 Oct 12 18:26:34.632607 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 76/146] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:26:34 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:26:34.686170 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-af7ffca8-d3cc-434b-939d-fd9e3a283a75 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:34.687168 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-af7ffca8-d3cc-434b-939d-fd9e3a283a75 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:34.694310 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-af7ffca8-d3cc-434b-939d-fd9e3a283a75 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:34.694757 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-af7ffca8-d3cc-434b-939d-fd9e3a283a75 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:34.695562 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-af7ffca8-d3cc-434b-939d-fd9e3a283a75 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:34.695949 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-af7ffca8-d3cc-434b-939d-fd9e3a283a75 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:34.792302 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-af7ffca8-d3cc-434b-939d-fd9e3a283a75 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 15064 microversion: 2.1 time: 0.110138 Oct 12 18:26:34.792962 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 71/147] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:26:34 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 15064 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:26:34.865037 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-792aa7a1-b1a5-417c-9155-0d52ab66b5c0 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:34.867179 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-792aa7a1-b1a5-417c-9155-0d52ab66b5c0 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:34.872145 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-792aa7a1-b1a5-417c-9155-0d52ab66b5c0 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:34.872644 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-792aa7a1-b1a5-417c-9155-0d52ab66b5c0 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:34.873406 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-792aa7a1-b1a5-417c-9155-0d52ab66b5c0 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:34.873831 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-792aa7a1-b1a5-417c-9155-0d52ab66b5c0 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:34.900911 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-792aa7a1-b1a5-417c-9155-0d52ab66b5c0 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Going to try to terminate instance {{(pid=109168) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 18:26:35.338448 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-792aa7a1-b1a5-417c-9155-0d52ab66b5c0 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 204 len: 0 microversion: 2.1 time: 0.477793 Oct 12 18:26:35.339030 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 77/148] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Oct 12 18:26:34 2021] DELETE /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 18:26:35.347841 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-750a3528-17cb-4952-9f04-3c9e5120354d tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:35.348553 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-750a3528-17cb-4952-9f04-3c9e5120354d tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:35.355093 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-750a3528-17cb-4952-9f04-3c9e5120354d tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:35.355580 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-750a3528-17cb-4952-9f04-3c9e5120354d tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:35.356335 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-750a3528-17cb-4952-9f04-3c9e5120354d tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:35.356785 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-750a3528-17cb-4952-9f04-3c9e5120354d tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:35.485849 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-750a3528-17cb-4952-9f04-3c9e5120354d tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:35.493631 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-750a3528-17cb-4952-9f04-3c9e5120354d tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1553 microversion: 2.1 time: 0.150204 Oct 12 18:26:35.494202 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 72/149] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:35 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:26:35.643225 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-188f3eec-752c-4c8b-9d77-56ce4be6d0b9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:35.644917 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-188f3eec-752c-4c8b-9d77-56ce4be6d0b9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:35.651476 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-188f3eec-752c-4c8b-9d77-56ce4be6d0b9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:35.651916 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-188f3eec-752c-4c8b-9d77-56ce4be6d0b9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:35.652697 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-188f3eec-752c-4c8b-9d77-56ce4be6d0b9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:35.653124 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-188f3eec-752c-4c8b-9d77-56ce4be6d0b9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:35.713326 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-188f3eec-752c-4c8b-9d77-56ce4be6d0b9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 14 microversion: 2.20 time: 0.073985 Oct 12 18:26:35.714197 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 78/150] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:26:35 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:26:35.803481 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-5feefe74-137a-4177-b34b-f01736bb4162 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:35.804732 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-5feefe74-137a-4177-b34b-f01736bb4162 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:35.811080 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5feefe74-137a-4177-b34b-f01736bb4162 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:35.811522 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5feefe74-137a-4177-b34b-f01736bb4162 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:35.812287 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5feefe74-137a-4177-b34b-f01736bb4162 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:35.812735 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5feefe74-137a-4177-b34b-f01736bb4162 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:35.898038 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-5feefe74-137a-4177-b34b-f01736bb4162 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 17984 microversion: 2.1 time: 0.097929 Oct 12 18:26:35.900232 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 73/151] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:26:35 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 17984 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:26:36.511010 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-722dcc41-e199-4e54-8bbf-c8c39f45e313 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:36.511704 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-722dcc41-e199-4e54-8bbf-c8c39f45e313 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:36.518127 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-722dcc41-e199-4e54-8bbf-c8c39f45e313 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:36.518572 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-722dcc41-e199-4e54-8bbf-c8c39f45e313 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:36.519372 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-722dcc41-e199-4e54-8bbf-c8c39f45e313 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:36.519807 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-722dcc41-e199-4e54-8bbf-c8c39f45e313 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:36.644752 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-722dcc41-e199-4e54-8bbf-c8c39f45e313 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:36.652897 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-722dcc41-e199-4e54-8bbf-c8c39f45e313 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1553 microversion: 2.1 time: 0.145991 Oct 12 18:26:36.653462 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 79/152] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:36 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1553 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:26:36.724326 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-fd031b88-fa9c-43b2-9ebc-402ff21398e7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:36.725502 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-fd031b88-fa9c-43b2-9ebc-402ff21398e7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:36.731796 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fd031b88-fa9c-43b2-9ebc-402ff21398e7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:36.732236 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fd031b88-fa9c-43b2-9ebc-402ff21398e7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:36.733045 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fd031b88-fa9c-43b2-9ebc-402ff21398e7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:36.733476 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fd031b88-fa9c-43b2-9ebc-402ff21398e7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:36.795435 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-fd031b88-fa9c-43b2-9ebc-402ff21398e7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 14 microversion: 2.20 time: 0.075484 Oct 12 18:26:36.798907 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 74/153] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:26:36 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:26:36.911736 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-15dd66c2-6519-47e2-b0d5-7ad6e15ea7d7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:36.919609 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-15dd66c2-6519-47e2-b0d5-7ad6e15ea7d7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:36.921992 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-15dd66c2-6519-47e2-b0d5-7ad6e15ea7d7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:36.922508 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-15dd66c2-6519-47e2-b0d5-7ad6e15ea7d7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:36.923957 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-15dd66c2-6519-47e2-b0d5-7ad6e15ea7d7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:36.924567 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-15dd66c2-6519-47e2-b0d5-7ad6e15ea7d7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:37.027507 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-15dd66c2-6519-47e2-b0d5-7ad6e15ea7d7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 19342 microversion: 2.1 time: 0.120397 Oct 12 18:26:37.028131 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 80/154] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:26:36 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 19342 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:26:37.670501 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-0e87e529-3d1c-4ff1-beb9-50e7e0d404e8 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:37.671188 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-0e87e529-3d1c-4ff1-beb9-50e7e0d404e8 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:37.678267 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0e87e529-3d1c-4ff1-beb9-50e7e0d404e8 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:37.678699 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0e87e529-3d1c-4ff1-beb9-50e7e0d404e8 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:37.679468 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0e87e529-3d1c-4ff1-beb9-50e7e0d404e8 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:37.679924 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0e87e529-3d1c-4ff1-beb9-50e7e0d404e8 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:37.808347 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c5d903a0-6ca5-4051-a5cd-e207f6b35e55 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:37.809431 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c5d903a0-6ca5-4051-a5cd-e207f6b35e55 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:37.816915 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c5d903a0-6ca5-4051-a5cd-e207f6b35e55 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:37.817515 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c5d903a0-6ca5-4051-a5cd-e207f6b35e55 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:37.821050 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-0e87e529-3d1c-4ff1-beb9-50e7e0d404e8 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:37.824104 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c5d903a0-6ca5-4051-a5cd-e207f6b35e55 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:37.824810 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c5d903a0-6ca5-4051-a5cd-e207f6b35e55 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:37.835643 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-0e87e529-3d1c-4ff1-beb9-50e7e0d404e8 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1553 microversion: 2.1 time: 0.168367 Oct 12 18:26:37.836185 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 75/155] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:37 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:26:38.039678 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-cdaeb810-12ac-49ef-84ef-9b73bfc1d357 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:38.040639 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-cdaeb810-12ac-49ef-84ef-9b73bfc1d357 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:38.046951 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cdaeb810-12ac-49ef-84ef-9b73bfc1d357 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:38.047397 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cdaeb810-12ac-49ef-84ef-9b73bfc1d357 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:38.054197 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cdaeb810-12ac-49ef-84ef-9b73bfc1d357 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:38.054197 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cdaeb810-12ac-49ef-84ef-9b73bfc1d357 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:41.214400 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-cdaeb810-12ac-49ef-84ef-9b73bfc1d357 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 25755 microversion: 2.1 time: 3.178187 Oct 12 18:26:41.217818 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c5d903a0-6ca5-4051-a5cd-e207f6b35e55 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 14 microversion: 2.20 time: 3.413682 Oct 12 18:26:41.218860 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 81/156] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:26:37 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 14 bytes in 3416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:26:41.219190 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 76/157] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:26:38 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 25755 bytes in 3185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:26:41.224892 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-813beccb-d012-43a8-9fd7-68145f0adec4 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:41.225578 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-813beccb-d012-43a8-9fd7-68145f0adec4 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:41.241102 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-813beccb-d012-43a8-9fd7-68145f0adec4 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:41.241670 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-813beccb-d012-43a8-9fd7-68145f0adec4 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:41.242556 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-813beccb-d012-43a8-9fd7-68145f0adec4 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:41.242991 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-813beccb-d012-43a8-9fd7-68145f0adec4 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:41.372563 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-813beccb-d012-43a8-9fd7-68145f0adec4 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:41.378271 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-813beccb-d012-43a8-9fd7-68145f0adec4 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1553 microversion: 2.1 time: 0.158207 Oct 12 18:26:41.378819 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 82/158] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:41 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:26:42.231409 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-ac03796d-60cc-4d52-8de6-dbcaba8394c7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:42.240869 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3754d53a-8870-4490-ac99-ab6daaa4e95b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:42.242662 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3754d53a-8870-4490-ac99-ab6daaa4e95b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:42.244459 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-ac03796d-60cc-4d52-8de6-dbcaba8394c7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:42.258467 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3754d53a-8870-4490-ac99-ab6daaa4e95b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:42.262052 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3754d53a-8870-4490-ac99-ab6daaa4e95b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:42.262052 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3754d53a-8870-4490-ac99-ab6daaa4e95b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:42.262052 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3754d53a-8870-4490-ac99-ab6daaa4e95b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:42.264651 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ac03796d-60cc-4d52-8de6-dbcaba8394c7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:42.265357 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ac03796d-60cc-4d52-8de6-dbcaba8394c7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:42.266440 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ac03796d-60cc-4d52-8de6-dbcaba8394c7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:42.267028 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ac03796d-60cc-4d52-8de6-dbcaba8394c7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:42.351181 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-ac03796d-60cc-4d52-8de6-dbcaba8394c7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 14 microversion: 2.20 time: 0.123531 Oct 12 18:26:42.351334 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 77/159] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:26:42 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:26:42.389501 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3754d53a-8870-4490-ac99-ab6daaa4e95b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 27036 microversion: 2.1 time: 0.156016 Oct 12 18:26:42.390319 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 83/160] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:26:42 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 27036 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:26:42.395145 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-6825c78e-497e-486c-bf1d-8a9a3c0aaec0 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:42.395848 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-6825c78e-497e-486c-bf1d-8a9a3c0aaec0 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:42.403017 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6825c78e-497e-486c-bf1d-8a9a3c0aaec0 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:42.403703 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6825c78e-497e-486c-bf1d-8a9a3c0aaec0 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:42.404532 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6825c78e-497e-486c-bf1d-8a9a3c0aaec0 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:42.404969 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6825c78e-497e-486c-bf1d-8a9a3c0aaec0 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:42.553529 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-6825c78e-497e-486c-bf1d-8a9a3c0aaec0 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:42.561861 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-6825c78e-497e-486c-bf1d-8a9a3c0aaec0 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1553 microversion: 2.1 time: 0.170627 Oct 12 18:26:42.562875 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 78/161] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:42 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:26:42.710616 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-b7bce882-b088-434b-89f0-921c4288ea00 req-a3e5d354-8e76-4320-9db8-27085b2f6486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b41fbf9-05a2-46c9-b7a6-124028aa23ab", "name": "network-vif-deleted", "tag": "b2fef676-0c4d-4948-82ee-4d56b09e2840"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:42.712297 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:26:42.712297 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:26:42.720794 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-b7bce882-b088-434b-89f0-921c4288ea00 req-a3e5d354-8e76-4320-9db8-27085b2f6486 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:42.721305 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-b7bce882-b088-434b-89f0-921c4288ea00 req-a3e5d354-8e76-4320-9db8-27085b2f6486 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:42.736053 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-b7bce882-b088-434b-89f0-921c4288ea00 req-a3e5d354-8e76-4320-9db8-27085b2f6486 service nova] Creating event network-vif-deleted:b2fef676-0c4d-4948-82ee-4d56b09e2840 for instance 7b41fbf9-05a2-46c9-b7a6-124028aa23ab on hv-cinder-81322 Oct 12 18:26:42.741947 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-b7bce882-b088-434b-89f0-921c4288ea00 req-a3e5d354-8e76-4320-9db8-27085b2f6486 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035637 Oct 12 18:26:42.742603 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 84/162] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:26:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:26:43.363382 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-df04fff5-75e8-476a-b59d-6c6606b32326 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:43.366742 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-df04fff5-75e8-476a-b59d-6c6606b32326 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:43.378762 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-df04fff5-75e8-476a-b59d-6c6606b32326 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:43.382594 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-df04fff5-75e8-476a-b59d-6c6606b32326 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:43.384988 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-df04fff5-75e8-476a-b59d-6c6606b32326 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:43.408948 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-df04fff5-75e8-476a-b59d-6c6606b32326 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:43.409401 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-34260088-f35c-40fa-a273-c2325f4777dc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:43.409401 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-34260088-f35c-40fa-a273-c2325f4777dc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:43.429548 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-34260088-f35c-40fa-a273-c2325f4777dc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:43.430241 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-34260088-f35c-40fa-a273-c2325f4777dc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:43.431977 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-34260088-f35c-40fa-a273-c2325f4777dc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:43.432736 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-34260088-f35c-40fa-a273-c2325f4777dc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:43.495838 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-df04fff5-75e8-476a-b59d-6c6606b32326 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 14 microversion: 2.20 time: 0.137058 Oct 12 18:26:43.496508 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 79/163] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:26:43 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:26:43.519533 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-34260088-f35c-40fa-a273-c2325f4777dc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 27582 microversion: 2.1 time: 0.118213 Oct 12 18:26:43.520778 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 85/164] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:26:43 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 27582 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:26:43.580802 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-7eed486e-b073-4a76-afee-d9a7f08c59d4 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:43.581533 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-7eed486e-b073-4a76-afee-d9a7f08c59d4 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:43.588033 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7eed486e-b073-4a76-afee-d9a7f08c59d4 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:43.588552 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7eed486e-b073-4a76-afee-d9a7f08c59d4 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:43.589330 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7eed486e-b073-4a76-afee-d9a7f08c59d4 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:43.589758 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7eed486e-b073-4a76-afee-d9a7f08c59d4 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:43.623955 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7eed486e-b073-4a76-afee-d9a7f08c59d4 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:43.624419 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7eed486e-b073-4a76-afee-d9a7f08c59d4 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:43.625049 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.objects.instance [None req-7eed486e-b073-4a76-afee-d9a7f08c59d4 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lazy-loading 'fault' on Instance uuid 7b41fbf9-05a2-46c9-b7a6-124028aa23ab {{(pid=109169) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:26:43.702902 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-7eed486e-b073-4a76-afee-d9a7f08c59d4 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15239896ef4b4f50af6af54712301f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6195bb2d64abfa8cd8671874f1830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:26:43.710986 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-7eed486e-b073-4a76-afee-d9a7f08c59d4 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 200 len: 1350 microversion: 2.1 time: 0.135038 Oct 12 18:26:43.711654 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 80/165] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:43 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 1350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:26:44.515440 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-08c0cfe1-85ec-4cfa-b822-67a56159a6b7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:44.516501 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-08c0cfe1-85ec-4cfa-b822-67a56159a6b7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:44.525435 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-08c0cfe1-85ec-4cfa-b822-67a56159a6b7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:44.526153 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-08c0cfe1-85ec-4cfa-b822-67a56159a6b7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:44.527077 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-08c0cfe1-85ec-4cfa-b822-67a56159a6b7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:44.527678 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-08c0cfe1-85ec-4cfa-b822-67a56159a6b7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:44.532773 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-3fe3592c-6c77-465d-b372-6e0ef23d67a1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:44.534850 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-3fe3592c-6c77-465d-b372-6e0ef23d67a1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:44.541593 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3fe3592c-6c77-465d-b372-6e0ef23d67a1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:44.542500 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3fe3592c-6c77-465d-b372-6e0ef23d67a1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:44.543477 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3fe3592c-6c77-465d-b372-6e0ef23d67a1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:44.544104 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3fe3592c-6c77-465d-b372-6e0ef23d67a1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:44.606447 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-08c0cfe1-85ec-4cfa-b822-67a56159a6b7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 10830 microversion: 2.20 time: 0.103197 Oct 12 18:26:44.607501 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 86/166] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:26:44 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 10830 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:26:44.638286 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-3fe3592c-6c77-465d-b372-6e0ef23d67a1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 27902 microversion: 2.1 time: 0.109704 Oct 12 18:26:44.639027 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 81/167] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:26:44 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 27902 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:26:44.728387 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2d858c8c-760a-4fe3-8a7c-419820555e22 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:44.729102 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2d858c8c-760a-4fe3-8a7c-419820555e22 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:44.735525 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2d858c8c-760a-4fe3-8a7c-419820555e22 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:44.735974 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2d858c8c-760a-4fe3-8a7c-419820555e22 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:44.736786 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2d858c8c-760a-4fe3-8a7c-419820555e22 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:44.737315 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2d858c8c-760a-4fe3-8a7c-419820555e22 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:44.751421 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-2d858c8c-760a-4fe3-8a7c-419820555e22 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] HTTP exception thrown: Instance 7b41fbf9-05a2-46c9-b7a6-124028aa23ab could not be found. Oct 12 18:26:44.752047 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2d858c8c-760a-4fe3-8a7c-419820555e22 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Returning 404 to user: Instance 7b41fbf9-05a2-46c9-b7a6-124028aa23ab could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:26:44.756426 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2d858c8c-760a-4fe3-8a7c-419820555e22 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 404 len: 111 microversion: 2.1 time: 0.028503 Oct 12 18:26:44.756426 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 87/168] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:44 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:26:44.857971 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-a1050b3b-63c2-437f-bdc5-61a760efe8d7 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:44.859763 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-a1050b3b-63c2-437f-bdc5-61a760efe8d7 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:44.866174 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a1050b3b-63c2-437f-bdc5-61a760efe8d7 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:44.866619 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a1050b3b-63c2-437f-bdc5-61a760efe8d7 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:44.867383 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a1050b3b-63c2-437f-bdc5-61a760efe8d7 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:44.867812 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a1050b3b-63c2-437f-bdc5-61a760efe8d7 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:44.881185 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.wsgi [None req-a1050b3b-63c2-437f-bdc5-61a760efe8d7 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] HTTP exception thrown: Instance 7b41fbf9-05a2-46c9-b7a6-124028aa23ab could not be found. Oct 12 18:26:44.881804 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-a1050b3b-63c2-437f-bdc5-61a760efe8d7 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Returning 404 to user: Instance 7b41fbf9-05a2-46c9-b7a6-124028aa23ab could not be found. {{(pid=109169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:26:44.882629 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-a1050b3b-63c2-437f-bdc5-61a760efe8d7 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.028852 Oct 12 18:26:44.883174 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 82/169] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Oct 12 18:26:44 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:26:45.620765 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9d60f27a-f605-42bb-889a-abc4c0b8b84e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:45.621925 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9d60f27a-f605-42bb-889a-abc4c0b8b84e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:45.629255 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9d60f27a-f605-42bb-889a-abc4c0b8b84e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:45.629706 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9d60f27a-f605-42bb-889a-abc4c0b8b84e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:45.630482 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9d60f27a-f605-42bb-889a-abc4c0b8b84e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:45.630910 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9d60f27a-f605-42bb-889a-abc4c0b8b84e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:45.650703 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-32dcfb57-f8c8-4171-b2ef-26ad29010ab8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:45.651920 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-32dcfb57-f8c8-4171-b2ef-26ad29010ab8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:45.657986 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-32dcfb57-f8c8-4171-b2ef-26ad29010ab8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:45.658684 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-32dcfb57-f8c8-4171-b2ef-26ad29010ab8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:45.660228 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-32dcfb57-f8c8-4171-b2ef-26ad29010ab8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:45.661126 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-32dcfb57-f8c8-4171-b2ef-26ad29010ab8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:45.720913 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9d60f27a-f605-42bb-889a-abc4c0b8b84e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 17602 microversion: 2.20 time: 0.106383 Oct 12 18:26:45.722274 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 88/170] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:26:45 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 17602 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:26:45.751081 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-32dcfb57-f8c8-4171-b2ef-26ad29010ab8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28200 microversion: 2.1 time: 0.103914 Oct 12 18:26:45.751950 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 83/171] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:26:45 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28200 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:26:46.320953 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-11d0b39c-66cb-45fc-92a1-6cb2b3d2c792 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:46.321753 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-11d0b39c-66cb-45fc-92a1-6cb2b3d2c792 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:46.328226 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-11d0b39c-66cb-45fc-92a1-6cb2b3d2c792 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:46.328717 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-11d0b39c-66cb-45fc-92a1-6cb2b3d2c792 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:46.329490 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-11d0b39c-66cb-45fc-92a1-6cb2b3d2c792 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:46.329926 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-11d0b39c-66cb-45fc-92a1-6cb2b3d2c792 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:46.344510 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-11d0b39c-66cb-45fc-92a1-6cb2b3d2c792 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] HTTP exception thrown: Instance 7b41fbf9-05a2-46c9-b7a6-124028aa23ab could not be found. Oct 12 18:26:46.345100 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-11d0b39c-66cb-45fc-92a1-6cb2b3d2c792 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Returning 404 to user: Instance 7b41fbf9-05a2-46c9-b7a6-124028aa23ab could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:26:46.345935 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-11d0b39c-66cb-45fc-92a1-6cb2b3d2c792 tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 404 len: 111 microversion: 2.1 time: 0.029203 Oct 12 18:26:46.346475 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 89/172] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Oct 12 18:26:46 2021] DELETE /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:26:46.356634 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-a9bb5c05-f9eb-4df0-a1f3-2f9cac21c41f tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:26:46.357416 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-a9bb5c05-f9eb-4df0-a1f3-2f9cac21c41f tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] [instance: 7b41fbf9-05a2-46c9-b7a6-124028aa23ab] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:46.364419 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a9bb5c05-f9eb-4df0-a1f3-2f9cac21c41f tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:46.364940 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a9bb5c05-f9eb-4df0-a1f3-2f9cac21c41f tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:46.365779 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a9bb5c05-f9eb-4df0-a1f3-2f9cac21c41f tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:46.366306 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a9bb5c05-f9eb-4df0-a1f3-2f9cac21c41f tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:46.384234 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.wsgi [None req-a9bb5c05-f9eb-4df0-a1f3-2f9cac21c41f tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] HTTP exception thrown: Instance 7b41fbf9-05a2-46c9-b7a6-124028aa23ab could not be found. Oct 12 18:26:46.384234 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-a9bb5c05-f9eb-4df0-a1f3-2f9cac21c41f tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] Returning 404 to user: Instance 7b41fbf9-05a2-46c9-b7a6-124028aa23ab could not be found. {{(pid=109169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:26:46.384234 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-a9bb5c05-f9eb-4df0-a1f3-2f9cac21c41f tempest-DeleteServersTestJSON-1501542091 tempest-DeleteServersTestJSON-1501542091-project] 10.222.0.18 "GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab" status: 404 len: 111 microversion: 2.1 time: 0.029010 Oct 12 18:26:46.384234 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 84/173] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:26:46 2021] GET /compute/v2.1/servers/7b41fbf9-05a2-46c9-b7a6-124028aa23ab => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:26:46.734203 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e5f9f202-1c56-42cd-9e2a-40d7c10e0c19 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:46.735119 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e5f9f202-1c56-42cd-9e2a-40d7c10e0c19 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:46.746183 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e5f9f202-1c56-42cd-9e2a-40d7c10e0c19 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:46.747026 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e5f9f202-1c56-42cd-9e2a-40d7c10e0c19 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:46.747821 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e5f9f202-1c56-42cd-9e2a-40d7c10e0c19 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:46.748300 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e5f9f202-1c56-42cd-9e2a-40d7c10e0c19 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:46.763773 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-14bdfa23-9206-448a-818a-1a627c45564a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:46.765517 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-14bdfa23-9206-448a-818a-1a627c45564a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:46.772731 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-14bdfa23-9206-448a-818a-1a627c45564a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:46.773711 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-14bdfa23-9206-448a-818a-1a627c45564a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:46.774713 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-14bdfa23-9206-448a-818a-1a627c45564a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:46.786711 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-14bdfa23-9206-448a-818a-1a627c45564a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:46.857600 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e5f9f202-1c56-42cd-9e2a-40d7c10e0c19 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 18915 microversion: 2.20 time: 0.128047 Oct 12 18:26:46.859518 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 90/174] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:26:46 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 18915 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:26:46.886405 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-14bdfa23-9206-448a-818a-1a627c45564a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28200 microversion: 2.1 time: 0.126640 Oct 12 18:26:46.887267 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 85/175] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:26:46 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28200 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:26:47.878553 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-37a66524-d0b0-419d-b498-d30b9ceb852f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:47.878553 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-37a66524-d0b0-419d-b498-d30b9ceb852f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:47.885761 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-37a66524-d0b0-419d-b498-d30b9ceb852f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:47.886432 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-37a66524-d0b0-419d-b498-d30b9ceb852f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:47.887402 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-37a66524-d0b0-419d-b498-d30b9ceb852f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:47.887997 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-37a66524-d0b0-419d-b498-d30b9ceb852f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:47.899229 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-a2ab53c6-5283-4289-802b-5003edc8f4ec tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:47.901515 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-a2ab53c6-5283-4289-802b-5003edc8f4ec tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:47.908679 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a2ab53c6-5283-4289-802b-5003edc8f4ec tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:47.909413 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a2ab53c6-5283-4289-802b-5003edc8f4ec tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:47.910414 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a2ab53c6-5283-4289-802b-5003edc8f4ec tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:47.911003 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a2ab53c6-5283-4289-802b-5003edc8f4ec tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:47.991172 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-37a66524-d0b0-419d-b498-d30b9ceb852f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 21674 microversion: 2.20 time: 0.124653 Oct 12 18:26:47.995209 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 91/176] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:26:47 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 21674 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:26:48.005377 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-a2ab53c6-5283-4289-802b-5003edc8f4ec tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28200 microversion: 2.1 time: 0.110033 Oct 12 18:26:48.007705 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 86/177] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:26:47 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28200 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:26:49.002959 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-cadf5147-3e06-45d7-ae99-cd8f443d56ec tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:49.003944 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-cadf5147-3e06-45d7-ae99-cd8f443d56ec tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:49.010253 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cadf5147-3e06-45d7-ae99-cd8f443d56ec tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:49.010692 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cadf5147-3e06-45d7-ae99-cd8f443d56ec tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:49.011443 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cadf5147-3e06-45d7-ae99-cd8f443d56ec tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:49.011866 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cadf5147-3e06-45d7-ae99-cd8f443d56ec tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:49.019681 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-d8aa00d3-bbcd-44e8-a8d3-de67737f0f0d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:49.020739 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-d8aa00d3-bbcd-44e8-a8d3-de67737f0f0d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:49.027338 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d8aa00d3-bbcd-44e8-a8d3-de67737f0f0d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:49.027784 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d8aa00d3-bbcd-44e8-a8d3-de67737f0f0d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:49.028588 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d8aa00d3-bbcd-44e8-a8d3-de67737f0f0d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:49.029080 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d8aa00d3-bbcd-44e8-a8d3-de67737f0f0d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:49.094765 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-cadf5147-3e06-45d7-ae99-cd8f443d56ec tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 23235 microversion: 2.20 time: 0.095562 Oct 12 18:26:49.095517 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 92/178] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:26:48 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 23235 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:26:49.098805 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-d8aa00d3-bbcd-44e8-a8d3-de67737f0f0d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28200 microversion: 2.1 time: 0.082891 Oct 12 18:26:49.099433 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 87/179] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:26:49 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28200 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:26:50.107177 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-84fae6a4-da0b-4bd8-837a-e10827520593 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:50.137866 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-84fae6a4-da0b-4bd8-837a-e10827520593 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:50.138051 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-49f199ab-b6c3-48d4-9f2f-657b384a94aa tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:50.138051 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-49f199ab-b6c3-48d4-9f2f-657b384a94aa tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:50.138653 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-84fae6a4-da0b-4bd8-837a-e10827520593 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:50.138653 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-84fae6a4-da0b-4bd8-837a-e10827520593 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:50.138653 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-84fae6a4-da0b-4bd8-837a-e10827520593 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:50.138653 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-84fae6a4-da0b-4bd8-837a-e10827520593 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:50.138956 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-49f199ab-b6c3-48d4-9f2f-657b384a94aa tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:50.138956 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-49f199ab-b6c3-48d4-9f2f-657b384a94aa tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:50.138956 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-49f199ab-b6c3-48d4-9f2f-657b384a94aa tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:50.138956 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-49f199ab-b6c3-48d4-9f2f-657b384a94aa tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:50.184747 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-49f199ab-b6c3-48d4-9f2f-657b384a94aa tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28200 microversion: 2.1 time: 0.077965 Oct 12 18:26:50.332666 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 88/180] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:26:50 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28200 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:26:50.333110 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-84fae6a4-da0b-4bd8-837a-e10827520593 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 25086 microversion: 2.20 time: 0.103015 Oct 12 18:26:50.333110 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 93/181] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:26:50 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 25086 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:26:51.339884 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-fbb07086-0251-40cc-9dc1-12b1e87ac2e9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:51.340938 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-fbb07086-0251-40cc-9dc1-12b1e87ac2e9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:51.350995 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b9c3720d-0d83-444a-b178-a43bdd780955 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:51.351994 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b9c3720d-0d83-444a-b178-a43bdd780955 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:51.368375 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b9c3720d-0d83-444a-b178-a43bdd780955 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:51.368375 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b9c3720d-0d83-444a-b178-a43bdd780955 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:51.368375 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b9c3720d-0d83-444a-b178-a43bdd780955 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:51.368375 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b9c3720d-0d83-444a-b178-a43bdd780955 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:51.368761 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fbb07086-0251-40cc-9dc1-12b1e87ac2e9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:51.368761 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fbb07086-0251-40cc-9dc1-12b1e87ac2e9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:51.368761 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fbb07086-0251-40cc-9dc1-12b1e87ac2e9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:51.368761 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fbb07086-0251-40cc-9dc1-12b1e87ac2e9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:51.437020 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b9c3720d-0d83-444a-b178-a43bdd780955 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 26778 microversion: 2.20 time: 0.092927 Oct 12 18:26:51.437740 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 94/182] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:26:51 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 26778 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:26:51.443786 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-fbb07086-0251-40cc-9dc1-12b1e87ac2e9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28200 microversion: 2.1 time: 0.108124 Oct 12 18:26:51.447463 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 89/183] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:26:51 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28200 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:26:52.450621 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-816efc7f-802a-42b8-9ec0-4c74b3920512 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:52.452205 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-816efc7f-802a-42b8-9ec0-4c74b3920512 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:52.456712 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-e164d110-58a4-45ce-9609-b361ca13e650 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:52.460518 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-e164d110-58a4-45ce-9609-b361ca13e650 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:52.460912 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-816efc7f-802a-42b8-9ec0-4c74b3920512 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:52.461370 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-816efc7f-802a-42b8-9ec0-4c74b3920512 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:52.462144 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-816efc7f-802a-42b8-9ec0-4c74b3920512 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:52.462723 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-816efc7f-802a-42b8-9ec0-4c74b3920512 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:52.475776 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e164d110-58a4-45ce-9609-b361ca13e650 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:52.475776 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e164d110-58a4-45ce-9609-b361ca13e650 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:52.475776 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e164d110-58a4-45ce-9609-b361ca13e650 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:52.475776 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e164d110-58a4-45ce-9609-b361ca13e650 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:52.551512 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-816efc7f-802a-42b8-9ec0-4c74b3920512 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 27643 microversion: 2.20 time: 0.105651 Oct 12 18:26:52.552664 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 95/184] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:26:52 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 27643 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:26:52.569189 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-e164d110-58a4-45ce-9609-b361ca13e650 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28200 microversion: 2.1 time: 0.117400 Oct 12 18:26:52.570485 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 90/185] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:26:52 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28200 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:26:53.567005 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ff39a89a-66b1-429d-8a59-16b25aeb2b20 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:53.568802 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ff39a89a-66b1-429d-8a59-16b25aeb2b20 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:53.577354 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ff39a89a-66b1-429d-8a59-16b25aeb2b20 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:53.578043 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ff39a89a-66b1-429d-8a59-16b25aeb2b20 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:53.579069 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ff39a89a-66b1-429d-8a59-16b25aeb2b20 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:53.579656 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ff39a89a-66b1-429d-8a59-16b25aeb2b20 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:53.589168 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-cf8bb916-f47d-4f20-8581-06d906801cbb tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:53.590330 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-cf8bb916-f47d-4f20-8581-06d906801cbb tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:53.597806 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cf8bb916-f47d-4f20-8581-06d906801cbb tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:53.598265 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cf8bb916-f47d-4f20-8581-06d906801cbb tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:53.600577 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cf8bb916-f47d-4f20-8581-06d906801cbb tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:53.602753 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cf8bb916-f47d-4f20-8581-06d906801cbb tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:53.679346 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-cf8bb916-f47d-4f20-8581-06d906801cbb tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28200 microversion: 2.1 time: 0.097035 Oct 12 18:26:53.680084 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 91/186] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:26:53 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28200 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:26:53.707378 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ff39a89a-66b1-429d-8a59-16b25aeb2b20 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 27878 microversion: 2.20 time: 0.147310 Oct 12 18:26:53.708929 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 96/187] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:26:53 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 27878 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:26:54.692321 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-51c2aade-475e-45f1-9956-e13ffc19403f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:54.693410 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-51c2aade-475e-45f1-9956-e13ffc19403f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:54.699916 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-51c2aade-475e-45f1-9956-e13ffc19403f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:54.700361 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-51c2aade-475e-45f1-9956-e13ffc19403f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:54.701182 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-51c2aade-475e-45f1-9956-e13ffc19403f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:54.701611 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-51c2aade-475e-45f1-9956-e13ffc19403f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:54.728767 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8f1378f3-d52a-421f-998b-a42c5f791fe1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:54.729733 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8f1378f3-d52a-421f-998b-a42c5f791fe1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:54.736101 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8f1378f3-d52a-421f-998b-a42c5f791fe1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:54.736602 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8f1378f3-d52a-421f-998b-a42c5f791fe1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:54.737386 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8f1378f3-d52a-421f-998b-a42c5f791fe1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:54.737817 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8f1378f3-d52a-421f-998b-a42c5f791fe1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:54.765878 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-51c2aade-475e-45f1-9956-e13ffc19403f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28200 microversion: 2.1 time: 0.077897 Oct 12 18:26:54.766449 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 92/188] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:26:54 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28200 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:26:54.809625 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8f1378f3-d52a-421f-998b-a42c5f791fe1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28189 microversion: 2.20 time: 0.084610 Oct 12 18:26:54.810399 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 97/189] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:26:54 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28189 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:26:55.786534 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-62f6f54a-6668-4719-9482-158caffe4b88 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:55.793877 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-62f6f54a-6668-4719-9482-158caffe4b88 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:55.794592 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-62f6f54a-6668-4719-9482-158caffe4b88 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:55.795038 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-62f6f54a-6668-4719-9482-158caffe4b88 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:55.796013 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-62f6f54a-6668-4719-9482-158caffe4b88 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:55.796461 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-62f6f54a-6668-4719-9482-158caffe4b88 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:55.828425 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ca51d37a-f7a2-4fd6-bb3b-88f619be58ef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:55.828425 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ca51d37a-f7a2-4fd6-bb3b-88f619be58ef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:55.831691 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ca51d37a-f7a2-4fd6-bb3b-88f619be58ef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:55.832270 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ca51d37a-f7a2-4fd6-bb3b-88f619be58ef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:55.833180 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ca51d37a-f7a2-4fd6-bb3b-88f619be58ef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:55.833718 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ca51d37a-f7a2-4fd6-bb3b-88f619be58ef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:55.883005 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-62f6f54a-6668-4719-9482-158caffe4b88 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28200 microversion: 2.1 time: 0.105349 Oct 12 18:26:55.884012 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 93/190] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:26:55 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28200 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:26:55.895811 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ca51d37a-f7a2-4fd6-bb3b-88f619be58ef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28189 microversion: 2.20 time: 0.077281 Oct 12 18:26:55.898402 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 98/191] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:26:55 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28189 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:26:56.897591 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-27033444-c1c8-47f2-ac23-a93d6d95bb46 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:56.898575 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-27033444-c1c8-47f2-ac23-a93d6d95bb46 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:56.905787 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-27033444-c1c8-47f2-ac23-a93d6d95bb46 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:56.906154 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-27033444-c1c8-47f2-ac23-a93d6d95bb46 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:56.906977 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-27033444-c1c8-47f2-ac23-a93d6d95bb46 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:56.907570 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-27033444-c1c8-47f2-ac23-a93d6d95bb46 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:56.911482 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7f72e375-2f6d-4e10-90de-56e6bff90e84 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:26:56.913460 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7f72e375-2f6d-4e10-90de-56e6bff90e84 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:26:56.922957 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7f72e375-2f6d-4e10-90de-56e6bff90e84 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:56.924981 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7f72e375-2f6d-4e10-90de-56e6bff90e84 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:26:56.926235 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7f72e375-2f6d-4e10-90de-56e6bff90e84 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:26:56.926874 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7f72e375-2f6d-4e10-90de-56e6bff90e84 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:01.621801 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-27033444-c1c8-47f2-ac23-a93d6d95bb46 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28200 microversion: 2.1 time: 4.728805 Oct 12 18:27:01.622703 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 94/192] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:26:56 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28200 bytes in 4731 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:27:01.635194 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7f72e375-2f6d-4e10-90de-56e6bff90e84 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28189 microversion: 2.20 time: 4.729545 Oct 12 18:27:01.636330 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 99/193] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:26:56 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28189 bytes in 4732 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:27:01.743820 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-deb58323-27bc-4aba-8917-aa894a24a076 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1492978951", "imageRef": "c79f0511-74c5-46f3-a7e6-cde6b09234ee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fac3b2f3-b1a1-43ec-856b-2b436d7ccd11"}]}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:01.797824 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.network.neutron [None req-deb58323-27bc-4aba-8917-aa894a24a076 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] validate_networks() for [('fac3b2f3-b1a1-43ec-856b-2b436d7ccd11', None, None, None, None, None)] {{(pid=109169) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 18:27:02.178018 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-deb58323-27bc-4aba-8917-aa894a24a076 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Flavor limits 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 18:27:02.178453 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-deb58323-27bc-4aba-8917-aa894a24a076 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Image limits 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 18:27:02.179209 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-deb58323-27bc-4aba-8917-aa894a24a076 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Flavor pref 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 18:27:02.179740 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-deb58323-27bc-4aba-8917-aa894a24a076 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Image pref 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 18:27:02.180152 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-deb58323-27bc-4aba-8917-aa894a24a076 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 18:27:02.189155 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-deb58323-27bc-4aba-8917-aa894a24a076 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:02.189600 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-deb58323-27bc-4aba-8917-aa894a24a076 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:02.190589 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-deb58323-27bc-4aba-8917-aa894a24a076 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:02.190870 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-deb58323-27bc-4aba-8917-aa894a24a076 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:02.207991 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.quota [None req-deb58323-27bc-4aba-8917-aa894a24a076 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Getting quotas for project 7f9fb6543096402dbf4351b0e6639431. Resources: {'instances', 'cores', 'ram'} {{(pid=109169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:27:02.212049 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.quota [None req-deb58323-27bc-4aba-8917-aa894a24a076 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Getting quotas for user adee358392264c9cad3d3ee92c9aadd2 and project 7f9fb6543096402dbf4351b0e6639431. Resources: {'instances', 'cores', 'ram'} {{(pid=109169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:27:02.223623 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-deb58323-27bc-4aba-8917-aa894a24a076 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Going to run 1 instances... {{(pid=109169) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 18:27:02.226103 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-deb58323-27bc-4aba-8917-aa894a24a076 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c79f0511-74c5-46f3-a7e6-cde6b09234ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109169) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 18:27:02.393554 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-deb58323-27bc-4aba-8917-aa894a24a076 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.768658 Oct 12 18:27:02.394286 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 95/194] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Oct 12 18:27:01 2021] POST /compute/v2.1/servers => generated 383 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 18:27:02.404906 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-59f0c551-9a1e-4498-9e61-7ac5ce8e1d3b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:02.405900 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-59f0c551-9a1e-4498-9e61-7ac5ce8e1d3b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:02.464945 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-59f0c551-9a1e-4498-9e61-7ac5ce8e1d3b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:02.473614 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-59f0c551-9a1e-4498-9e61-7ac5ce8e1d3b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1222 microversion: 2.1 time: 0.072822 Oct 12 18:27:02.474778 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 100/195] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:02 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1222 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:02.544144 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-1387edf6-bcb4-4759-a774-18d6442e8c0d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1153246674", "imageRef": "c79f0511-74c5-46f3-a7e6-cde6b09234ee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fac3b2f3-b1a1-43ec-856b-2b436d7ccd11"}]}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:02.599459 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.network.neutron [None req-1387edf6-bcb4-4759-a774-18d6442e8c0d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] validate_networks() for [('fac3b2f3-b1a1-43ec-856b-2b436d7ccd11', None, None, None, None, None)] {{(pid=109169) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 18:27:02.634599 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-053be73d-0c02-4a74-8f55-51ae164d56d1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:02.636256 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-053be73d-0c02-4a74-8f55-51ae164d56d1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:02.646657 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-053be73d-0c02-4a74-8f55-51ae164d56d1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:02.647104 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-053be73d-0c02-4a74-8f55-51ae164d56d1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:02.647889 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-053be73d-0c02-4a74-8f55-51ae164d56d1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:02.648509 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-053be73d-0c02-4a74-8f55-51ae164d56d1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:02.716795 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-053be73d-0c02-4a74-8f55-51ae164d56d1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28200 microversion: 2.1 time: 0.086991 Oct 12 18:27:02.717460 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 101/196] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:02 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28200 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:27:02.722859 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-425ae99a-3ca6-4d55-8211-ecf6e6a91a6d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:02.724148 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-425ae99a-3ca6-4d55-8211-ecf6e6a91a6d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:02.730784 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-425ae99a-3ca6-4d55-8211-ecf6e6a91a6d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:02.734867 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-425ae99a-3ca6-4d55-8211-ecf6e6a91a6d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:02.734867 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-425ae99a-3ca6-4d55-8211-ecf6e6a91a6d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:02.734867 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-425ae99a-3ca6-4d55-8211-ecf6e6a91a6d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:02.808663 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-425ae99a-3ca6-4d55-8211-ecf6e6a91a6d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28189 microversion: 2.20 time: 0.089697 Oct 12 18:27:02.809365 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 102/197] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:02 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28189 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:27:03.017482 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-1387edf6-bcb4-4759-a774-18d6442e8c0d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Flavor limits 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 18:27:03.018001 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-1387edf6-bcb4-4759-a774-18d6442e8c0d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Image limits 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 18:27:03.018718 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-1387edf6-bcb4-4759-a774-18d6442e8c0d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Flavor pref 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 18:27:03.019361 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-1387edf6-bcb4-4759-a774-18d6442e8c0d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Image pref 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 18:27:03.020034 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-1387edf6-bcb4-4759-a774-18d6442e8c0d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 18:27:03.030296 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1387edf6-bcb4-4759-a774-18d6442e8c0d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:03.030861 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1387edf6-bcb4-4759-a774-18d6442e8c0d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:03.031758 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1387edf6-bcb4-4759-a774-18d6442e8c0d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:03.032536 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1387edf6-bcb4-4759-a774-18d6442e8c0d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:03.050820 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.quota [None req-1387edf6-bcb4-4759-a774-18d6442e8c0d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Getting quotas for project 7f9fb6543096402dbf4351b0e6639431. Resources: {'instances', 'cores', 'ram'} {{(pid=109169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:27:03.054824 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.quota [None req-1387edf6-bcb4-4759-a774-18d6442e8c0d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Getting quotas for user adee358392264c9cad3d3ee92c9aadd2 and project 7f9fb6543096402dbf4351b0e6639431. Resources: {'instances', 'cores', 'ram'} {{(pid=109169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:27:03.067274 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-1387edf6-bcb4-4759-a774-18d6442e8c0d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Going to run 1 instances... {{(pid=109169) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 18:27:03.069503 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-1387edf6-bcb4-4759-a774-18d6442e8c0d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c79f0511-74c5-46f3-a7e6-cde6b09234ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109169) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 18:27:03.282393 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-1387edf6-bcb4-4759-a774-18d6442e8c0d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.742015 Oct 12 18:27:03.288644 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 96/198] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Oct 12 18:27:02 2021] POST /compute/v2.1/servers => generated 383 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 18:27:03.293481 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-501029e6-992d-4349-8015-e5dac0b1aa3d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:03.294170 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-501029e6-992d-4349-8015-e5dac0b1aa3d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:03.360259 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-501029e6-992d-4349-8015-e5dac0b1aa3d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:03.369092 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-501029e6-992d-4349-8015-e5dac0b1aa3d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1222 microversion: 2.1 time: 0.079446 Oct 12 18:27:03.379729 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 103/199] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:03 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:03.729491 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-885b2c61-4a5b-4995-a72e-8ee51824701c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:03.730460 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-885b2c61-4a5b-4995-a72e-8ee51824701c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:03.750390 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-885b2c61-4a5b-4995-a72e-8ee51824701c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:03.750777 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-885b2c61-4a5b-4995-a72e-8ee51824701c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:03.751615 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-885b2c61-4a5b-4995-a72e-8ee51824701c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:03.752756 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-885b2c61-4a5b-4995-a72e-8ee51824701c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:03.822915 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-33306f4e-201a-4c06-9564-5775da6a5611 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:03.824354 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-33306f4e-201a-4c06-9564-5775da6a5611 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:03.833453 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-33306f4e-201a-4c06-9564-5775da6a5611 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:03.833949 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-33306f4e-201a-4c06-9564-5775da6a5611 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:03.834991 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-33306f4e-201a-4c06-9564-5775da6a5611 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:03.835587 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-33306f4e-201a-4c06-9564-5775da6a5611 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:08.129844 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-885b2c61-4a5b-4995-a72e-8ee51824701c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28200 microversion: 2.1 time: 4.404057 Oct 12 18:27:08.130492 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 97/200] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:03 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28200 bytes in 4406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:27:08.141488 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-33306f4e-201a-4c06-9564-5775da6a5611 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28189 microversion: 2.20 time: 4.323070 Oct 12 18:27:08.143514 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 104/201] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:03 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28189 bytes in 4326 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:27:08.152500 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-5122022e-0438-4011-915a-68672d65cbda tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:08.153784 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-5122022e-0438-4011-915a-68672d65cbda tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:08.165081 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5122022e-0438-4011-915a-68672d65cbda tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:08.165529 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5122022e-0438-4011-915a-68672d65cbda tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:08.166318 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5122022e-0438-4011-915a-68672d65cbda tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:08.166754 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5122022e-0438-4011-915a-68672d65cbda tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:08.258780 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-5122022e-0438-4011-915a-68672d65cbda tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:08.266972 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-5122022e-0438-4011-915a-68672d65cbda tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1226 microversion: 2.1 time: 0.134932 Oct 12 18:27:08.268085 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 98/202] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:08 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1226 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:09.150833 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c769343c-f716-4839-bc8e-e9cbbc795723 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:09.152526 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c769343c-f716-4839-bc8e-e9cbbc795723 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:09.156941 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-5c309127-8ade-4de8-99be-2e0d72e5e98d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:09.159161 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-5c309127-8ade-4de8-99be-2e0d72e5e98d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:09.160561 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c769343c-f716-4839-bc8e-e9cbbc795723 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:09.161027 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c769343c-f716-4839-bc8e-e9cbbc795723 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:09.161910 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c769343c-f716-4839-bc8e-e9cbbc795723 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:09.162408 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c769343c-f716-4839-bc8e-e9cbbc795723 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:09.168914 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5c309127-8ade-4de8-99be-2e0d72e5e98d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:09.170275 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5c309127-8ade-4de8-99be-2e0d72e5e98d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:09.171046 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5c309127-8ade-4de8-99be-2e0d72e5e98d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:09.171914 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5c309127-8ade-4de8-99be-2e0d72e5e98d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:09.234820 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c769343c-f716-4839-bc8e-e9cbbc795723 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28200 microversion: 2.1 time: 0.088886 Oct 12 18:27:09.235468 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 105/203] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:09 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28200 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:27:09.257517 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-5c309127-8ade-4de8-99be-2e0d72e5e98d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28189 microversion: 2.20 time: 0.106961 Oct 12 18:27:09.258151 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 99/204] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:09 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28189 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:27:09.285534 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-206d40dc-87da-4cb1-b0f0-7104e1a56257 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:09.286213 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-206d40dc-87da-4cb1-b0f0-7104e1a56257 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:09.292560 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-206d40dc-87da-4cb1-b0f0-7104e1a56257 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:09.293004 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-206d40dc-87da-4cb1-b0f0-7104e1a56257 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:09.293770 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-206d40dc-87da-4cb1-b0f0-7104e1a56257 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:09.294198 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-206d40dc-87da-4cb1-b0f0-7104e1a56257 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:09.369118 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-206d40dc-87da-4cb1-b0f0-7104e1a56257 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:09.384448 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-206d40dc-87da-4cb1-b0f0-7104e1a56257 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1282 microversion: 2.1 time: 0.103907 Oct 12 18:27:09.385327 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 106/205] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:09 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1282 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:10.249464 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-1bfe1fd6-964e-4b3a-a2d3-d6120c77a559 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:10.251427 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-1bfe1fd6-964e-4b3a-a2d3-d6120c77a559 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:10.260664 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1bfe1fd6-964e-4b3a-a2d3-d6120c77a559 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:10.261507 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1bfe1fd6-964e-4b3a-a2d3-d6120c77a559 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:10.262519 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1bfe1fd6-964e-4b3a-a2d3-d6120c77a559 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:10.263167 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1bfe1fd6-964e-4b3a-a2d3-d6120c77a559 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:10.271244 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d21414f4-62ea-4e91-b77d-4d7d43f55a24 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:10.272354 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d21414f4-62ea-4e91-b77d-4d7d43f55a24 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:10.281866 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d21414f4-62ea-4e91-b77d-4d7d43f55a24 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:10.282648 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d21414f4-62ea-4e91-b77d-4d7d43f55a24 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:10.284108 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d21414f4-62ea-4e91-b77d-4d7d43f55a24 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:10.284931 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d21414f4-62ea-4e91-b77d-4d7d43f55a24 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:10.353603 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-1bfe1fd6-964e-4b3a-a2d3-d6120c77a559 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28200 microversion: 2.1 time: 0.108788 Oct 12 18:27:10.356936 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 100/206] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:10 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28200 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:27:10.369296 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d21414f4-62ea-4e91-b77d-4d7d43f55a24 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28189 microversion: 2.20 time: 0.102718 Oct 12 18:27:10.370033 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 107/207] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:10 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28189 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:27:10.403603 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-58956b96-251c-46dc-a6b4-a1849e59c1a1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:10.409678 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-58956b96-251c-46dc-a6b4-a1849e59c1a1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:10.415048 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-58956b96-251c-46dc-a6b4-a1849e59c1a1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:10.415890 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-58956b96-251c-46dc-a6b4-a1849e59c1a1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:10.417518 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-58956b96-251c-46dc-a6b4-a1849e59c1a1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:10.418581 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-58956b96-251c-46dc-a6b4-a1849e59c1a1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:10.607255 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-58956b96-251c-46dc-a6b4-a1849e59c1a1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:10.623104 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-58956b96-251c-46dc-a6b4-a1849e59c1a1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1322 microversion: 2.1 time: 0.224980 Oct 12 18:27:10.624599 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 101/208] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:10 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:11.368525 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-6e408ff5-8cc7-4682-9a8c-432ed1889a11 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:11.370864 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-6e408ff5-8cc7-4682-9a8c-432ed1889a11 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:11.382846 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-755e1d73-3778-41a9-9802-192620034e0b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:11.383530 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6e408ff5-8cc7-4682-9a8c-432ed1889a11 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:11.383991 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6e408ff5-8cc7-4682-9a8c-432ed1889a11 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:11.384804 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6e408ff5-8cc7-4682-9a8c-432ed1889a11 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:11.385184 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-755e1d73-3778-41a9-9802-192620034e0b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:11.386421 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6e408ff5-8cc7-4682-9a8c-432ed1889a11 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:11.391908 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-755e1d73-3778-41a9-9802-192620034e0b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:11.392467 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-755e1d73-3778-41a9-9802-192620034e0b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:11.393447 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-755e1d73-3778-41a9-9802-192620034e0b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:11.394203 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-755e1d73-3778-41a9-9802-192620034e0b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:11.469376 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-6e408ff5-8cc7-4682-9a8c-432ed1889a11 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28200 microversion: 2.1 time: 0.106707 Oct 12 18:27:11.471051 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 108/209] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:11 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28200 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:27:11.482295 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-755e1d73-3778-41a9-9802-192620034e0b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28189 microversion: 2.20 time: 0.101846 Oct 12 18:27:11.482295 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 102/210] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:11 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28189 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:27:11.500045 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-f8a4fe60-11c1-465f-885d-bc191ebff3fa req-6c01b2f0-a11f-481d-adb4-68b4189d7406 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40b9689f-c878-4777-b81b-976434249834", "tag": "28d1dc71-8166-49a5-a37e-6d2062224b4a"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:11.500045 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:27:11.500045 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:27:11.507618 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-f8a4fe60-11c1-465f-885d-bc191ebff3fa req-6c01b2f0-a11f-481d-adb4-68b4189d7406 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:11.508056 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-f8a4fe60-11c1-465f-885d-bc191ebff3fa req-6c01b2f0-a11f-481d-adb4-68b4189d7406 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:11.519742 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-f8a4fe60-11c1-465f-885d-bc191ebff3fa req-6c01b2f0-a11f-481d-adb4-68b4189d7406 service nova] Creating event network-changed:28d1dc71-8166-49a5-a37e-6d2062224b4a for instance 40b9689f-c878-4777-b81b-976434249834 on hv-cinder-81322 Oct 12 18:27:11.523777 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-f8a4fe60-11c1-465f-885d-bc191ebff3fa req-6c01b2f0-a11f-481d-adb4-68b4189d7406 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030138 Oct 12 18:27:11.524359 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 109/211] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:27:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:27:11.643355 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-8cbbd94f-86a8-4b27-9f8a-046ea920b527 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:11.644326 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-8cbbd94f-86a8-4b27-9f8a-046ea920b527 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:11.652435 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8cbbd94f-86a8-4b27-9f8a-046ea920b527 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:11.652865 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8cbbd94f-86a8-4b27-9f8a-046ea920b527 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:11.653866 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8cbbd94f-86a8-4b27-9f8a-046ea920b527 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:11.654478 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8cbbd94f-86a8-4b27-9f8a-046ea920b527 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:11.960516 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-362bd11a-4322-4f0b-87ca-f7cbac9ad574 req-1609b52d-dce7-4da8-b6f5-95e781dc390f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ade368f-e898-4346-83a8-3d3eb86c8192", "tag": "fc8c6d70-7941-4089-842b-2e9d99ab6161"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:11.962215 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:27:11.962215 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:27:11.979708 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-8cbbd94f-86a8-4b27-9f8a-046ea920b527 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:11.983864 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-362bd11a-4322-4f0b-87ca-f7cbac9ad574 req-1609b52d-dce7-4da8-b6f5-95e781dc390f service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:11.984349 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-362bd11a-4322-4f0b-87ca-f7cbac9ad574 req-1609b52d-dce7-4da8-b6f5-95e781dc390f service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:11.987400 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-8cbbd94f-86a8-4b27-9f8a-046ea920b527 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1322 microversion: 2.1 time: 0.348131 Oct 12 18:27:11.988427 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 103/212] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:11 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1322 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:27:12.001710 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-362bd11a-4322-4f0b-87ca-f7cbac9ad574 req-1609b52d-dce7-4da8-b6f5-95e781dc390f service nova] Creating event network-changed:fc8c6d70-7941-4089-842b-2e9d99ab6161 for instance 4ade368f-e898-4346-83a8-3d3eb86c8192 on hv-cinder-81322 Oct 12 18:27:12.008082 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-362bd11a-4322-4f0b-87ca-f7cbac9ad574 req-1609b52d-dce7-4da8-b6f5-95e781dc390f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051587 Oct 12 18:27:12.009571 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 110/213] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:27:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 18:27:12.042141 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-8a651201-0f4c-4a62-bd94-f71cff46e304 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1082067081", "imageRef": "c79f0511-74c5-46f3-a7e6-cde6b09234ee", "flavorRef": "452", "networks": [{"uuid": "0999fba4-b001-46c1-a95d-aa5cf57e9c09"}]}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:12.121208 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.network.neutron [None req-8a651201-0f4c-4a62-bd94-f71cff46e304 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] validate_networks() for [('0999fba4-b001-46c1-a95d-aa5cf57e9c09', None, None, None, None, None)] {{(pid=109169) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 18:27:12.485704 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-998869a0-d97e-43ef-a282-e5ec504d38c5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:12.486676 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-998869a0-d97e-43ef-a282-e5ec504d38c5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:12.498281 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-998869a0-d97e-43ef-a282-e5ec504d38c5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:12.500012 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-998869a0-d97e-43ef-a282-e5ec504d38c5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:12.501254 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-998869a0-d97e-43ef-a282-e5ec504d38c5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:12.505642 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-998869a0-d97e-43ef-a282-e5ec504d38c5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:12.594091 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-998869a0-d97e-43ef-a282-e5ec504d38c5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28200 microversion: 2.1 time: 0.113136 Oct 12 18:27:12.594091 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 111/214] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:12 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28200 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:27:12.601407 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-33c6d22f-92b9-46a9-b139-f244572fa5c5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:12.602486 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-33c6d22f-92b9-46a9-b139-f244572fa5c5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:12.616515 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-33c6d22f-92b9-46a9-b139-f244572fa5c5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:12.617212 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-33c6d22f-92b9-46a9-b139-f244572fa5c5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:12.618231 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-33c6d22f-92b9-46a9-b139-f244572fa5c5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:12.619617 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-33c6d22f-92b9-46a9-b139-f244572fa5c5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:12.700700 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-33c6d22f-92b9-46a9-b139-f244572fa5c5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28189 microversion: 2.20 time: 0.105040 Oct 12 18:27:12.701447 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 112/215] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:12 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28189 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:27:12.803370 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-8a651201-0f4c-4a62-bd94-f71cff46e304 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Flavor limits 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 18:27:12.803370 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-8a651201-0f4c-4a62-bd94-f71cff46e304 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Image limits 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 18:27:12.803370 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-8a651201-0f4c-4a62-bd94-f71cff46e304 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Flavor pref 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 18:27:12.803370 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-8a651201-0f4c-4a62-bd94-f71cff46e304 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Image pref 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 18:27:12.803370 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-8a651201-0f4c-4a62-bd94-f71cff46e304 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 18:27:12.810115 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8a651201-0f4c-4a62-bd94-f71cff46e304 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:12.810555 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8a651201-0f4c-4a62-bd94-f71cff46e304 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:12.811547 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8a651201-0f4c-4a62-bd94-f71cff46e304 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:12.812143 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8a651201-0f4c-4a62-bd94-f71cff46e304 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:12.832959 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.quota [None req-8a651201-0f4c-4a62-bd94-f71cff46e304 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Getting quotas for project ec6b4ea245ba455cb3a788ef7907c669. Resources: {'instances', 'cores', 'ram'} {{(pid=109169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:27:12.837569 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.quota [None req-8a651201-0f4c-4a62-bd94-f71cff46e304 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Getting quotas for user ac7aaed40f314bf397c414162affa8ad and project ec6b4ea245ba455cb3a788ef7907c669. Resources: {'instances', 'cores', 'ram'} {{(pid=109169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:27:12.849281 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-8a651201-0f4c-4a62-bd94-f71cff46e304 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Going to run 1 instances... {{(pid=109169) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 18:27:12.854277 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-8a651201-0f4c-4a62-bd94-f71cff46e304 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: 7248b1cd-5fb8-47c6-a410-5538946ca79a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c79f0511-74c5-46f3-a7e6-cde6b09234ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109169) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 18:27:12.997926 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-8a651201-0f4c-4a62-bd94-f71cff46e304 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.962751 Oct 12 18:27:12.998701 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 104/216] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Oct 12 18:27:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 18:27:13.005130 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a1dbb765-4489-4656-aadc-06a6696b32c0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:13.005832 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a1dbb765-4489-4656-aadc-06a6696b32c0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:13.014003 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-f7745913-4288-43c1-8750-93a4f95d35c6 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:13.014629 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-f7745913-4288-43c1-8750-93a4f95d35c6 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: 7248b1cd-5fb8-47c6-a410-5538946ca79a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:13.021120 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a1dbb765-4489-4656-aadc-06a6696b32c0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:13.021565 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a1dbb765-4489-4656-aadc-06a6696b32c0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:13.022536 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a1dbb765-4489-4656-aadc-06a6696b32c0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:13.023130 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a1dbb765-4489-4656-aadc-06a6696b32c0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:13.141613 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-f7745913-4288-43c1-8750-93a4f95d35c6 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:13.148807 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-f7745913-4288-43c1-8750-93a4f95d35c6 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a" status: 200 len: 1214 microversion: 2.1 time: 0.138383 Oct 12 18:27:13.151547 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 105/217] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:13 2021] GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a => generated 1214 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:13.317819 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a1dbb765-4489-4656-aadc-06a6696b32c0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:13.328024 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a1dbb765-4489-4656-aadc-06a6696b32c0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1322 microversion: 2.1 time: 0.327076 Oct 12 18:27:13.337784 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 113/218] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:12 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:13.604055 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-0a31f013-309a-4c28-afd1-fa2d6a205338 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:13.605068 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-0a31f013-309a-4c28-afd1-fa2d6a205338 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:13.612012 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0a31f013-309a-4c28-afd1-fa2d6a205338 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:13.612368 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0a31f013-309a-4c28-afd1-fa2d6a205338 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:13.613166 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0a31f013-309a-4c28-afd1-fa2d6a205338 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:13.613602 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0a31f013-309a-4c28-afd1-fa2d6a205338 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:13.715793 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-297bf945-b6c0-4beb-b761-82d7834489a1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:13.717455 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-297bf945-b6c0-4beb-b761-82d7834489a1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:13.727963 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-297bf945-b6c0-4beb-b761-82d7834489a1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:13.728433 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-297bf945-b6c0-4beb-b761-82d7834489a1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:13.729208 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-297bf945-b6c0-4beb-b761-82d7834489a1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:13.729633 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-297bf945-b6c0-4beb-b761-82d7834489a1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:13.914886 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-0a31f013-309a-4c28-afd1-fa2d6a205338 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28491 microversion: 2.1 time: 0.314290 Oct 12 18:27:13.917987 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 106/219] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:13 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28491 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:27:13.925377 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-297bf945-b6c0-4beb-b761-82d7834489a1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28189 microversion: 2.20 time: 0.216461 Oct 12 18:27:13.926959 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 114/220] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:13 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28189 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:27:14.175265 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-4d47c3cc-6f89-4c12-b9b0-5c7fc46a8dc7 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:14.175930 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-4d47c3cc-6f89-4c12-b9b0-5c7fc46a8dc7 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: 7248b1cd-5fb8-47c6-a410-5538946ca79a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:14.227993 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-4d47c3cc-6f89-4c12-b9b0-5c7fc46a8dc7 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:14.234463 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-4d47c3cc-6f89-4c12-b9b0-5c7fc46a8dc7 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a" status: 200 len: 1214 microversion: 2.1 time: 0.063193 Oct 12 18:27:14.234969 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 107/221] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:14 2021] GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a => generated 1214 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:14.346024 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2697ecad-3f82-44d2-858b-01004d360e4c tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:14.346757 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2697ecad-3f82-44d2-858b-01004d360e4c tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:14.353552 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2697ecad-3f82-44d2-858b-01004d360e4c tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:14.354002 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2697ecad-3f82-44d2-858b-01004d360e4c tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:14.354784 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2697ecad-3f82-44d2-858b-01004d360e4c tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:14.355281 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2697ecad-3f82-44d2-858b-01004d360e4c tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:14.487591 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2697ecad-3f82-44d2-858b-01004d360e4c tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:14.495451 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2697ecad-3f82-44d2-858b-01004d360e4c tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1322 microversion: 2.1 time: 0.153665 Oct 12 18:27:14.496074 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 115/222] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:14 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:14.927641 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-a78cb29f-28fc-49f0-b492-c37cb14ad7a0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:14.928615 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-a78cb29f-28fc-49f0-b492-c37cb14ad7a0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:14.936822 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a78cb29f-28fc-49f0-b492-c37cb14ad7a0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:14.937267 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a78cb29f-28fc-49f0-b492-c37cb14ad7a0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:14.938040 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a78cb29f-28fc-49f0-b492-c37cb14ad7a0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:14.938464 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a78cb29f-28fc-49f0-b492-c37cb14ad7a0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:14.941698 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8e898325-5c19-4caf-ac3b-6df1c0fb10b7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:14.943151 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8e898325-5c19-4caf-ac3b-6df1c0fb10b7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:14.952979 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8e898325-5c19-4caf-ac3b-6df1c0fb10b7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:14.953977 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8e898325-5c19-4caf-ac3b-6df1c0fb10b7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:14.955322 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8e898325-5c19-4caf-ac3b-6df1c0fb10b7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:14.956256 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8e898325-5c19-4caf-ac3b-6df1c0fb10b7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:15.040505 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-a78cb29f-28fc-49f0-b492-c37cb14ad7a0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28491 microversion: 2.1 time: 0.116941 Oct 12 18:27:15.043884 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 108/223] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:14 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28491 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:27:15.056987 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8e898325-5c19-4caf-ac3b-6df1c0fb10b7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28189 microversion: 2.20 time: 0.122498 Oct 12 18:27:15.057628 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 116/224] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:14 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28189 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:27:15.251467 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-cca8b024-4873-4305-bc10-d518550deaac tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:15.252162 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-cca8b024-4873-4305-bc10-d518550deaac tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: 7248b1cd-5fb8-47c6-a410-5538946ca79a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:15.258727 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cca8b024-4873-4305-bc10-d518550deaac tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:15.259282 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cca8b024-4873-4305-bc10-d518550deaac tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:15.260048 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cca8b024-4873-4305-bc10-d518550deaac tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:15.260514 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cca8b024-4873-4305-bc10-d518550deaac tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:15.327361 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-cca8b024-4873-4305-bc10-d518550deaac tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:15.340035 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-cca8b024-4873-4305-bc10-d518550deaac tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a" status: 200 len: 1266 microversion: 2.1 time: 0.092446 Oct 12 18:27:15.340646 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 109/225] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:15 2021] GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:15.513565 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8344f834-d7ab-4c75-a17a-27a85b6f8e8e tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:15.514251 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8344f834-d7ab-4c75-a17a-27a85b6f8e8e tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:15.521080 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8344f834-d7ab-4c75-a17a-27a85b6f8e8e tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:15.521519 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8344f834-d7ab-4c75-a17a-27a85b6f8e8e tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:15.522300 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8344f834-d7ab-4c75-a17a-27a85b6f8e8e tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:15.522790 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8344f834-d7ab-4c75-a17a-27a85b6f8e8e tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:15.701518 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8344f834-d7ab-4c75-a17a-27a85b6f8e8e tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:15.709565 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8344f834-d7ab-4c75-a17a-27a85b6f8e8e tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1322 microversion: 2.1 time: 0.200029 Oct 12 18:27:15.710402 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 117/226] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:15 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:27:16.062850 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-4f34dcf4-3877-4a3a-a15c-2243caf152a8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:16.063367 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-4f34dcf4-3877-4a3a-a15c-2243caf152a8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:16.069151 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1a39b9ff-e82f-4805-a91e-86cfd13f88fe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:16.070053 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1a39b9ff-e82f-4805-a91e-86cfd13f88fe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:16.075912 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1a39b9ff-e82f-4805-a91e-86cfd13f88fe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:16.076365 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1a39b9ff-e82f-4805-a91e-86cfd13f88fe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:16.077201 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1a39b9ff-e82f-4805-a91e-86cfd13f88fe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:16.077631 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1a39b9ff-e82f-4805-a91e-86cfd13f88fe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:16.079373 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4f34dcf4-3877-4a3a-a15c-2243caf152a8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:16.080821 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4f34dcf4-3877-4a3a-a15c-2243caf152a8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:16.082152 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4f34dcf4-3877-4a3a-a15c-2243caf152a8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:16.083149 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4f34dcf4-3877-4a3a-a15c-2243caf152a8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:16.162346 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1a39b9ff-e82f-4805-a91e-86cfd13f88fe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28189 microversion: 2.20 time: 0.097410 Oct 12 18:27:16.163906 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 118/227] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:16 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28189 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:27:16.358316 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-53fe2982-da88-4432-8e74-ad0a402d8cbc tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:16.359897 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-53fe2982-da88-4432-8e74-ad0a402d8cbc tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: 7248b1cd-5fb8-47c6-a410-5538946ca79a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:16.367949 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-53fe2982-da88-4432-8e74-ad0a402d8cbc tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:16.368767 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-53fe2982-da88-4432-8e74-ad0a402d8cbc tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:16.369697 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-53fe2982-da88-4432-8e74-ad0a402d8cbc tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:16.370352 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-53fe2982-da88-4432-8e74-ad0a402d8cbc tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:16.379549 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-4f34dcf4-3877-4a3a-a15c-2243caf152a8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.322755 Oct 12 18:27:16.379549 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 110/228] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:16 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:27:16.457867 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-53fe2982-da88-4432-8e74-ad0a402d8cbc tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:16.472091 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-53fe2982-da88-4432-8e74-ad0a402d8cbc tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a" status: 200 len: 1272 microversion: 2.1 time: 0.117363 Oct 12 18:27:16.473915 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 119/229] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:16 2021] GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a => generated 1272 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:16.734439 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-e6021c73-e904-410c-9984-0ba67ca10f96 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:16.735144 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-e6021c73-e904-410c-9984-0ba67ca10f96 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:16.744802 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e6021c73-e904-410c-9984-0ba67ca10f96 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:16.745621 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e6021c73-e904-410c-9984-0ba67ca10f96 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:16.747076 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e6021c73-e904-410c-9984-0ba67ca10f96 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:16.748339 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e6021c73-e904-410c-9984-0ba67ca10f96 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:16.925967 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-e6021c73-e904-410c-9984-0ba67ca10f96 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:16.933468 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-e6021c73-e904-410c-9984-0ba67ca10f96 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1322 microversion: 2.1 time: 0.203110 Oct 12 18:27:16.934039 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 111/230] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:16 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:27:17.174747 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ac0230b7-54e3-4ea6-8580-8eb5be3f1dbf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:17.176238 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ac0230b7-54e3-4ea6-8580-8eb5be3f1dbf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:17.182790 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ac0230b7-54e3-4ea6-8580-8eb5be3f1dbf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:17.186609 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ac0230b7-54e3-4ea6-8580-8eb5be3f1dbf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:17.186609 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ac0230b7-54e3-4ea6-8580-8eb5be3f1dbf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:17.186609 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ac0230b7-54e3-4ea6-8580-8eb5be3f1dbf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:17.386906 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-34b3b771-d29e-40d2-b967-a461d23e2b30 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:17.387980 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-34b3b771-d29e-40d2-b967-a461d23e2b30 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:17.394485 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-34b3b771-d29e-40d2-b967-a461d23e2b30 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:17.395023 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-34b3b771-d29e-40d2-b967-a461d23e2b30 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:17.395873 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-34b3b771-d29e-40d2-b967-a461d23e2b30 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:17.396448 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-34b3b771-d29e-40d2-b967-a461d23e2b30 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:17.481011 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-34b3b771-d29e-40d2-b967-a461d23e2b30 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.097026 Oct 12 18:27:17.485328 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 112/231] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:17 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:27:17.489738 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ac0230b7-54e3-4ea6-8580-8eb5be3f1dbf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28189 microversion: 2.20 time: 0.318000 Oct 12 18:27:17.491735 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 120/232] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:17 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28189 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:27:17.493630 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-9108c07a-ddce-4b9c-bb98-b1ce24dc3f8e tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:17.494610 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-9108c07a-ddce-4b9c-bb98-b1ce24dc3f8e tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: 7248b1cd-5fb8-47c6-a410-5538946ca79a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:17.502078 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9108c07a-ddce-4b9c-bb98-b1ce24dc3f8e tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:17.502519 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9108c07a-ddce-4b9c-bb98-b1ce24dc3f8e tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:17.503277 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9108c07a-ddce-4b9c-bb98-b1ce24dc3f8e tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:17.503882 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9108c07a-ddce-4b9c-bb98-b1ce24dc3f8e tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:17.665408 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-9108c07a-ddce-4b9c-bb98-b1ce24dc3f8e tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:17.680430 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-9108c07a-ddce-4b9c-bb98-b1ce24dc3f8e tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a" status: 200 len: 1314 microversion: 2.1 time: 0.192631 Oct 12 18:27:17.681170 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 113/233] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:17 2021] GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:27:17.951568 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4f3c5119-625c-467d-a721-ab51db35bd8b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:17.952751 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4f3c5119-625c-467d-a721-ab51db35bd8b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:17.959879 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4f3c5119-625c-467d-a721-ab51db35bd8b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:17.968037 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4f3c5119-625c-467d-a721-ab51db35bd8b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:17.968037 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4f3c5119-625c-467d-a721-ab51db35bd8b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:17.968037 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4f3c5119-625c-467d-a721-ab51db35bd8b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:18.134807 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4f3c5119-625c-467d-a721-ab51db35bd8b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:18.143503 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4f3c5119-625c-467d-a721-ab51db35bd8b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1322 microversion: 2.1 time: 0.195904 Oct 12 18:27:18.145663 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 121/234] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:17 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:18.346476 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-7d03c271-85ed-4151-a66e-0049af8deb7d req-390f4a03-a139-424c-8cc5-14590d4a0a28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7248b1cd-5fb8-47c6-a410-5538946ca79a", "tag": "bd84017e-938d-4387-96eb-f90e80ff8a30"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:18.348228 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:27:18.348228 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:27:18.355119 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-7d03c271-85ed-4151-a66e-0049af8deb7d req-390f4a03-a139-424c-8cc5-14590d4a0a28 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:18.355632 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-7d03c271-85ed-4151-a66e-0049af8deb7d req-390f4a03-a139-424c-8cc5-14590d4a0a28 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:18.367397 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-7d03c271-85ed-4151-a66e-0049af8deb7d req-390f4a03-a139-424c-8cc5-14590d4a0a28 service nova] Creating event network-changed:bd84017e-938d-4387-96eb-f90e80ff8a30 for instance 7248b1cd-5fb8-47c6-a410-5538946ca79a on hv-cinder-81322 Oct 12 18:27:18.372080 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-7d03c271-85ed-4151-a66e-0049af8deb7d req-390f4a03-a139-424c-8cc5-14590d4a0a28 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029649 Oct 12 18:27:18.372813 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 114/235] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:27:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:27:18.493334 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-80ee16f2-d4d7-4fae-869b-939db44433eb tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:18.494461 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-80ee16f2-d4d7-4fae-869b-939db44433eb tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:18.500314 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-80ee16f2-d4d7-4fae-869b-939db44433eb tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:18.500805 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-80ee16f2-d4d7-4fae-869b-939db44433eb tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:18.502137 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-80ee16f2-d4d7-4fae-869b-939db44433eb tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:18.502499 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-80ee16f2-d4d7-4fae-869b-939db44433eb tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:18.508583 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-343a880f-5b39-4579-856e-b6ee67c306e8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:18.510179 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-343a880f-5b39-4579-856e-b6ee67c306e8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:18.518622 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-343a880f-5b39-4579-856e-b6ee67c306e8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:18.519212 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-343a880f-5b39-4579-856e-b6ee67c306e8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:18.520281 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-343a880f-5b39-4579-856e-b6ee67c306e8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:18.521039 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-343a880f-5b39-4579-856e-b6ee67c306e8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:22.387080 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-343a880f-5b39-4579-856e-b6ee67c306e8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28189 microversion: 2.20 time: 3.886047 Oct 12 18:27:22.390333 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 115/236] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:18 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28189 bytes in 3890 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:27:22.393435 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-80ee16f2-d4d7-4fae-869b-939db44433eb tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 3.903359 Oct 12 18:27:22.395607 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-f7de76d0-5052-4372-8efc-f47a305c75e0 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:22.396505 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-f7de76d0-5052-4372-8efc-f47a305c75e0 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: 7248b1cd-5fb8-47c6-a410-5538946ca79a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:22.403400 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 122/237] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:18 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 3914 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:27:22.403881 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f7de76d0-5052-4372-8efc-f47a305c75e0 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:22.404592 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f7de76d0-5052-4372-8efc-f47a305c75e0 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:22.405643 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f7de76d0-5052-4372-8efc-f47a305c75e0 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:22.406429 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f7de76d0-5052-4372-8efc-f47a305c75e0 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:22.408308 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-041e8c84-e9af-4411-b996-524d01cdcf03 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:22.409095 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-041e8c84-e9af-4411-b996-524d01cdcf03 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:22.415959 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-041e8c84-e9af-4411-b996-524d01cdcf03 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:22.416426 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-041e8c84-e9af-4411-b996-524d01cdcf03 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:22.417224 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-041e8c84-e9af-4411-b996-524d01cdcf03 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:22.417661 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-041e8c84-e9af-4411-b996-524d01cdcf03 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:22.603873 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-f7de76d0-5052-4372-8efc-f47a305c75e0 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:22.619375 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-041e8c84-e9af-4411-b996-524d01cdcf03 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:22.627083 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-f7de76d0-5052-4372-8efc-f47a305c75e0 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a" status: 200 len: 1314 microversion: 2.1 time: 0.234320 Oct 12 18:27:22.633018 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 116/238] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:22 2021] GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:22.641234 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-041e8c84-e9af-4411-b996-524d01cdcf03 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1322 microversion: 2.1 time: 0.236253 Oct 12 18:27:22.642619 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 123/239] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:22 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:23.399408 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-656d1b48-a8fa-4b38-b9c0-35cb10e8f1c5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:23.400312 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-656d1b48-a8fa-4b38-b9c0-35cb10e8f1c5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:23.408259 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-656d1b48-a8fa-4b38-b9c0-35cb10e8f1c5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:23.408618 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-656d1b48-a8fa-4b38-b9c0-35cb10e8f1c5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:23.409380 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-656d1b48-a8fa-4b38-b9c0-35cb10e8f1c5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:23.409892 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-656d1b48-a8fa-4b38-b9c0-35cb10e8f1c5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:23.418459 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3ef97360-893f-4eb6-bc6e-89060977c488 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:23.420012 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3ef97360-893f-4eb6-bc6e-89060977c488 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:23.429655 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3ef97360-893f-4eb6-bc6e-89060977c488 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:23.430473 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3ef97360-893f-4eb6-bc6e-89060977c488 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:23.431873 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3ef97360-893f-4eb6-bc6e-89060977c488 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:23.432768 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3ef97360-893f-4eb6-bc6e-89060977c488 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:24.023444 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3ef97360-893f-4eb6-bc6e-89060977c488 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.611557 Oct 12 18:27:24.024089 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 124/240] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:23 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:27:24.029245 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9ca8a708-dc43-4c28-a943-b4c567b09729 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:24.029926 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9ca8a708-dc43-4c28-a943-b4c567b09729 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: 7248b1cd-5fb8-47c6-a410-5538946ca79a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:24.032142 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-656d1b48-a8fa-4b38-b9c0-35cb10e8f1c5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28189 microversion: 2.20 time: 0.636540 Oct 12 18:27:24.032810 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 117/241] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:23 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28189 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:27:24.037613 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-557ce0da-4bc9-4a77-aaeb-017b7bf3fde2 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:24.042370 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-557ce0da-4bc9-4a77-aaeb-017b7bf3fde2 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:24.042493 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9ca8a708-dc43-4c28-a943-b4c567b09729 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:24.042493 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9ca8a708-dc43-4c28-a943-b4c567b09729 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:24.042493 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9ca8a708-dc43-4c28-a943-b4c567b09729 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:24.042493 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9ca8a708-dc43-4c28-a943-b4c567b09729 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:24.044618 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-557ce0da-4bc9-4a77-aaeb-017b7bf3fde2 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:24.045065 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-557ce0da-4bc9-4a77-aaeb-017b7bf3fde2 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:24.045835 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-557ce0da-4bc9-4a77-aaeb-017b7bf3fde2 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:24.046362 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-557ce0da-4bc9-4a77-aaeb-017b7bf3fde2 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:24.227420 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9ca8a708-dc43-4c28-a943-b4c567b09729 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:24.230210 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-557ce0da-4bc9-4a77-aaeb-017b7bf3fde2 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:24.234691 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9ca8a708-dc43-4c28-a943-b4c567b09729 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a" status: 200 len: 1314 microversion: 2.1 time: 0.209302 Oct 12 18:27:24.235343 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 125/242] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:24 2021] GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:24.238157 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-557ce0da-4bc9-4a77-aaeb-017b7bf3fde2 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1322 microversion: 2.1 time: 0.204178 Oct 12 18:27:24.238843 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 118/243] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:24 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:25.035158 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5658d307-b08d-4274-81b7-1ae3ae1fd36d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:25.036103 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5658d307-b08d-4274-81b7-1ae3ae1fd36d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:25.042496 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5658d307-b08d-4274-81b7-1ae3ae1fd36d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:25.045464 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-14e755a0-99da-4fd4-8860-d34d12ab2bc9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:25.045901 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5658d307-b08d-4274-81b7-1ae3ae1fd36d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:25.046002 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-14e755a0-99da-4fd4-8860-d34d12ab2bc9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:25.046117 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5658d307-b08d-4274-81b7-1ae3ae1fd36d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:25.046117 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5658d307-b08d-4274-81b7-1ae3ae1fd36d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:25.050132 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-14e755a0-99da-4fd4-8860-d34d12ab2bc9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:25.050710 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-14e755a0-99da-4fd4-8860-d34d12ab2bc9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:25.051469 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-14e755a0-99da-4fd4-8860-d34d12ab2bc9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:25.051891 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-14e755a0-99da-4fd4-8860-d34d12ab2bc9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:25.201736 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-14e755a0-99da-4fd4-8860-d34d12ab2bc9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28189 microversion: 2.20 time: 0.162320 Oct 12 18:27:25.202382 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 119/244] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:25 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28189 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:27:25.206020 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5658d307-b08d-4274-81b7-1ae3ae1fd36d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.174433 Oct 12 18:27:25.207442 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 126/245] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:25 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:27:25.255509 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-fa310bb8-89ed-407a-a87e-6af83511be01 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:25.256197 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-fa310bb8-89ed-407a-a87e-6af83511be01 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: 7248b1cd-5fb8-47c6-a410-5538946ca79a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:25.257409 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8d4b7580-703f-4827-9c8b-dc3e70e15edc tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:25.258158 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8d4b7580-703f-4827-9c8b-dc3e70e15edc tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:25.262560 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fa310bb8-89ed-407a-a87e-6af83511be01 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:25.263003 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fa310bb8-89ed-407a-a87e-6af83511be01 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:25.263766 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fa310bb8-89ed-407a-a87e-6af83511be01 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:25.264190 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fa310bb8-89ed-407a-a87e-6af83511be01 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:25.264601 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8d4b7580-703f-4827-9c8b-dc3e70e15edc tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:25.265044 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8d4b7580-703f-4827-9c8b-dc3e70e15edc tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:25.265913 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8d4b7580-703f-4827-9c8b-dc3e70e15edc tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:25.266347 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8d4b7580-703f-4827-9c8b-dc3e70e15edc tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:25.442309 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8d4b7580-703f-4827-9c8b-dc3e70e15edc tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:25.449927 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8d4b7580-703f-4827-9c8b-dc3e70e15edc tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1322 microversion: 2.1 time: 0.196520 Oct 12 18:27:25.450082 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-fa310bb8-89ed-407a-a87e-6af83511be01 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:25.450501 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 127/246] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:25 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:27:25.457678 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-fa310bb8-89ed-407a-a87e-6af83511be01 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a" status: 200 len: 1314 microversion: 2.1 time: 0.206674 Oct 12 18:27:25.458228 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 120/247] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:25 2021] GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:26.217509 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-579558b2-a0a7-4d6a-95e5-5e92fb47f3ed tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:26.218061 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-b1d1ae3e-981d-4a31-a396-cd468051c03a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:26.218576 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-b1d1ae3e-981d-4a31-a396-cd468051c03a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:26.219112 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-579558b2-a0a7-4d6a-95e5-5e92fb47f3ed tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:26.225278 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b1d1ae3e-981d-4a31-a396-cd468051c03a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:26.225719 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b1d1ae3e-981d-4a31-a396-cd468051c03a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:26.226482 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b1d1ae3e-981d-4a31-a396-cd468051c03a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:26.226863 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-579558b2-a0a7-4d6a-95e5-5e92fb47f3ed tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:26.226969 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b1d1ae3e-981d-4a31-a396-cd468051c03a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:26.227302 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-579558b2-a0a7-4d6a-95e5-5e92fb47f3ed tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:26.228065 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-579558b2-a0a7-4d6a-95e5-5e92fb47f3ed tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:26.228516 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-579558b2-a0a7-4d6a-95e5-5e92fb47f3ed tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:26.587422 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-b1d1ae3e-981d-4a31-a396-cd468051c03a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.373063 Oct 12 18:27:26.588257 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 121/248] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:26 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:27:26.592006 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-579558b2-a0a7-4d6a-95e5-5e92fb47f3ed tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28189 microversion: 2.20 time: 0.380964 Oct 12 18:27:26.592749 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 128/249] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:26 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28189 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:27:26.596522 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-25c0a1cb-0fff-450b-a633-bf24a2992dd5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:26.597271 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-25c0a1cb-0fff-450b-a633-bf24a2992dd5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:26.598396 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5f35e759-8220-46e3-bdaf-90838eeed233 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:26.599154 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5f35e759-8220-46e3-bdaf-90838eeed233 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: 7248b1cd-5fb8-47c6-a410-5538946ca79a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:26.603985 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-25c0a1cb-0fff-450b-a633-bf24a2992dd5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:26.604479 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-25c0a1cb-0fff-450b-a633-bf24a2992dd5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:26.605252 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-25c0a1cb-0fff-450b-a633-bf24a2992dd5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:26.605649 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5f35e759-8220-46e3-bdaf-90838eeed233 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:26.605769 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-25c0a1cb-0fff-450b-a633-bf24a2992dd5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:26.606102 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5f35e759-8220-46e3-bdaf-90838eeed233 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:26.606870 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5f35e759-8220-46e3-bdaf-90838eeed233 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:26.607297 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5f35e759-8220-46e3-bdaf-90838eeed233 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:26.785694 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-25c0a1cb-0fff-450b-a633-bf24a2992dd5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:26.790384 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5f35e759-8220-46e3-bdaf-90838eeed233 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:26.793044 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-25c0a1cb-0fff-450b-a633-bf24a2992dd5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1322 microversion: 2.1 time: 0.203654 Oct 12 18:27:26.793620 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 122/250] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:26 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:26.798812 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5f35e759-8220-46e3-bdaf-90838eeed233 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a" status: 200 len: 1314 microversion: 2.1 time: 0.204215 Oct 12 18:27:26.799458 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 129/251] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:26 2021] GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:27.155101 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-7eb3f4d8-7ff9-4cf5-aae5-b419dbabef9b req-f2fe9d49-fa04-4f3f-b0f0-97cbe039f84b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40b9689f-c878-4777-b81b-976434249834", "name": "network-vif-plugged", "status": "completed", "tag": "28d1dc71-8166-49a5-a37e-6d2062224b4a"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:27.156636 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:27:27.156636 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:27:27.164139 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-7eb3f4d8-7ff9-4cf5-aae5-b419dbabef9b req-f2fe9d49-fa04-4f3f-b0f0-97cbe039f84b service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:27.164637 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-7eb3f4d8-7ff9-4cf5-aae5-b419dbabef9b req-f2fe9d49-fa04-4f3f-b0f0-97cbe039f84b service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:27.175213 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-7eb3f4d8-7ff9-4cf5-aae5-b419dbabef9b req-f2fe9d49-fa04-4f3f-b0f0-97cbe039f84b service nova] Creating event network-vif-plugged:28d1dc71-8166-49a5-a37e-6d2062224b4a for instance 40b9689f-c878-4777-b81b-976434249834 on hv-cinder-81322 Oct 12 18:27:27.180117 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-7eb3f4d8-7ff9-4cf5-aae5-b419dbabef9b req-f2fe9d49-fa04-4f3f-b0f0-97cbe039f84b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028677 Oct 12 18:27:27.180812 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 123/252] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:27:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:27:27.598964 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8fa0ee2a-abbe-42c0-9fce-729298a127f8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:27.599965 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8fa0ee2a-abbe-42c0-9fce-729298a127f8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:27.604896 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-1a1342b0-a59d-4d9a-ab8b-eafccf9ad91a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:27.605864 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-1a1342b0-a59d-4d9a-ab8b-eafccf9ad91a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:27.605991 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8fa0ee2a-abbe-42c0-9fce-729298a127f8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:27.606367 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8fa0ee2a-abbe-42c0-9fce-729298a127f8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:27.607142 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8fa0ee2a-abbe-42c0-9fce-729298a127f8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:27.607574 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8fa0ee2a-abbe-42c0-9fce-729298a127f8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:27.612622 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1a1342b0-a59d-4d9a-ab8b-eafccf9ad91a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:27.613068 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1a1342b0-a59d-4d9a-ab8b-eafccf9ad91a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:27.613837 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1a1342b0-a59d-4d9a-ab8b-eafccf9ad91a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:27.614267 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1a1342b0-a59d-4d9a-ab8b-eafccf9ad91a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:27.948646 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-1a1342b0-a59d-4d9a-ab8b-eafccf9ad91a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28189 microversion: 2.20 time: 0.347505 Oct 12 18:27:27.949293 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 124/253] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:27 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28189 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:27:27.954070 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8fa0ee2a-abbe-42c0-9fce-729298a127f8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.358633 Oct 12 18:27:27.954216 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-d2d2b843-0065-46f1-8774-59057218fea2 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:27.954831 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 130/254] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:27 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:27:27.954963 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-d2d2b843-0065-46f1-8774-59057218fea2 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:27.959898 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-28ccfd56-e3cd-4d1f-81b2-299bf373be4d tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:27.960621 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-28ccfd56-e3cd-4d1f-81b2-299bf373be4d tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: 7248b1cd-5fb8-47c6-a410-5538946ca79a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:27.963345 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d2d2b843-0065-46f1-8774-59057218fea2 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:27.963345 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d2d2b843-0065-46f1-8774-59057218fea2 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:27.963345 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d2d2b843-0065-46f1-8774-59057218fea2 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:27.963345 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d2d2b843-0065-46f1-8774-59057218fea2 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:27.966766 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-28ccfd56-e3cd-4d1f-81b2-299bf373be4d tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:27.967213 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-28ccfd56-e3cd-4d1f-81b2-299bf373be4d tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:27.967979 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-28ccfd56-e3cd-4d1f-81b2-299bf373be4d tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:27.968481 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-28ccfd56-e3cd-4d1f-81b2-299bf373be4d tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:28.152961 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-d2d2b843-0065-46f1-8774-59057218fea2 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:28.157591 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-28ccfd56-e3cd-4d1f-81b2-299bf373be4d tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:28.160577 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-d2d2b843-0065-46f1-8774-59057218fea2 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1322 microversion: 2.1 time: 0.209979 Oct 12 18:27:28.161160 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 125/255] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:27 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:28.165085 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-28ccfd56-e3cd-4d1f-81b2-299bf373be4d tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a" status: 200 len: 1314 microversion: 2.1 time: 0.208806 Oct 12 18:27:28.165810 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 131/256] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:27 2021] GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:28.960767 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-6c383d5e-29fb-4f5f-b1db-b5c42d0c0689 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:28.961911 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-6c383d5e-29fb-4f5f-b1db-b5c42d0c0689 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:28.975525 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-da8f7b7e-b3e1-4e63-ad98-51b85cc8074b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:28.975525 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-da8f7b7e-b3e1-4e63-ad98-51b85cc8074b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:28.976018 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6c383d5e-29fb-4f5f-b1db-b5c42d0c0689 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:28.976018 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6c383d5e-29fb-4f5f-b1db-b5c42d0c0689 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:28.976018 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6c383d5e-29fb-4f5f-b1db-b5c42d0c0689 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:28.976018 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6c383d5e-29fb-4f5f-b1db-b5c42d0c0689 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:28.977678 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-da8f7b7e-b3e1-4e63-ad98-51b85cc8074b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:28.978409 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-da8f7b7e-b3e1-4e63-ad98-51b85cc8074b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:28.979472 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-da8f7b7e-b3e1-4e63-ad98-51b85cc8074b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:28.980160 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-da8f7b7e-b3e1-4e63-ad98-51b85cc8074b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:29.047389 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-6c383d5e-29fb-4f5f-b1db-b5c42d0c0689 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28189 microversion: 2.20 time: 0.090111 Oct 12 18:27:29.049201 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 126/257] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:28 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28189 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:27:29.053270 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-da8f7b7e-b3e1-4e63-ad98-51b85cc8074b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.090121 Oct 12 18:27:29.055475 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 132/258] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:28 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:27:29.177951 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-3055fb6d-b517-4428-b4fa-6d0dc8d774b6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:29.178566 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-3055fb6d-b517-4428-b4fa-6d0dc8d774b6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:29.185131 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3055fb6d-b517-4428-b4fa-6d0dc8d774b6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:29.185579 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3055fb6d-b517-4428-b4fa-6d0dc8d774b6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:29.185869 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-da2ee9b6-9c92-46e3-a784-e8480f9a2765 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:29.186347 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3055fb6d-b517-4428-b4fa-6d0dc8d774b6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:29.186714 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-da2ee9b6-9c92-46e3-a784-e8480f9a2765 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: 7248b1cd-5fb8-47c6-a410-5538946ca79a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:29.186817 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3055fb6d-b517-4428-b4fa-6d0dc8d774b6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:29.194703 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-da2ee9b6-9c92-46e3-a784-e8480f9a2765 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:29.195140 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-da2ee9b6-9c92-46e3-a784-e8480f9a2765 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:29.196061 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-da2ee9b6-9c92-46e3-a784-e8480f9a2765 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:29.196799 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-da2ee9b6-9c92-46e3-a784-e8480f9a2765 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:29.389795 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-3055fb6d-b517-4428-b4fa-6d0dc8d774b6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:29.396221 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-da2ee9b6-9c92-46e3-a784-e8480f9a2765 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:29.399417 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-3055fb6d-b517-4428-b4fa-6d0dc8d774b6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1322 microversion: 2.1 time: 0.225544 Oct 12 18:27:29.400781 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 127/259] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:29 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:29.405150 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-da2ee9b6-9c92-46e3-a784-e8480f9a2765 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a" status: 200 len: 1314 microversion: 2.1 time: 0.223560 Oct 12 18:27:29.406225 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 133/260] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:29 2021] GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:27:29.408938 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-361d788f-f3cf-4263-b064-17c4a17296a7 req-d4a7f528-0f97-4158-a6a2-043455764439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ade368f-e898-4346-83a8-3d3eb86c8192", "name": "network-vif-plugged", "status": "completed", "tag": "fc8c6d70-7941-4089-842b-2e9d99ab6161"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:29.410431 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:27:29.410431 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:27:29.417379 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-361d788f-f3cf-4263-b064-17c4a17296a7 req-d4a7f528-0f97-4158-a6a2-043455764439 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:29.417812 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-361d788f-f3cf-4263-b064-17c4a17296a7 req-d4a7f528-0f97-4158-a6a2-043455764439 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:29.429966 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-361d788f-f3cf-4263-b064-17c4a17296a7 req-d4a7f528-0f97-4158-a6a2-043455764439 service nova] Creating event network-vif-plugged:fc8c6d70-7941-4089-842b-2e9d99ab6161 for instance 4ade368f-e898-4346-83a8-3d3eb86c8192 on hv-cinder-81322 Oct 12 18:27:29.435027 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-361d788f-f3cf-4263-b064-17c4a17296a7 req-d4a7f528-0f97-4158-a6a2-043455764439 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032870 Oct 12 18:27:29.435629 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 128/261] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:27:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:27:30.063227 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-04412ab7-ffa1-45a8-97fd-bd307669cc56 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:30.064649 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-04412ab7-ffa1-45a8-97fd-bd307669cc56 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:30.069393 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-00ba760c-ff2e-4262-b05c-43f4483b0dae tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:30.070391 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-00ba760c-ff2e-4262-b05c-43f4483b0dae tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:30.072741 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-04412ab7-ffa1-45a8-97fd-bd307669cc56 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:30.073289 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-04412ab7-ffa1-45a8-97fd-bd307669cc56 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:30.077274 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-04412ab7-ffa1-45a8-97fd-bd307669cc56 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:30.077274 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-04412ab7-ffa1-45a8-97fd-bd307669cc56 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:30.077585 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-00ba760c-ff2e-4262-b05c-43f4483b0dae tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:30.079558 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-00ba760c-ff2e-4262-b05c-43f4483b0dae tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:30.086036 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-00ba760c-ff2e-4262-b05c-43f4483b0dae tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:30.087370 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-00ba760c-ff2e-4262-b05c-43f4483b0dae tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:30.181923 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-00ba760c-ff2e-4262-b05c-43f4483b0dae tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.120833 Oct 12 18:27:30.182675 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 129/262] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:30 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:27:30.192233 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-04412ab7-ffa1-45a8-97fd-bd307669cc56 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28189 microversion: 2.20 time: 0.134449 Oct 12 18:27:30.193147 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 134/263] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:30 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28189 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:27:30.421182 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-1c069d3b-d426-4d57-a7c0-773f02ae8e1a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:30.423810 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-1c069d3b-d426-4d57-a7c0-773f02ae8e1a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:30.424243 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ff8996b7-aac1-4912-8d95-2e87d0eed20d tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:30.425416 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ff8996b7-aac1-4912-8d95-2e87d0eed20d tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: 7248b1cd-5fb8-47c6-a410-5538946ca79a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:30.431221 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1c069d3b-d426-4d57-a7c0-773f02ae8e1a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:30.431741 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1c069d3b-d426-4d57-a7c0-773f02ae8e1a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:30.432839 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1c069d3b-d426-4d57-a7c0-773f02ae8e1a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:30.433723 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1c069d3b-d426-4d57-a7c0-773f02ae8e1a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:30.433898 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ff8996b7-aac1-4912-8d95-2e87d0eed20d tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:30.434498 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ff8996b7-aac1-4912-8d95-2e87d0eed20d tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:30.435487 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ff8996b7-aac1-4912-8d95-2e87d0eed20d tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:30.435915 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ff8996b7-aac1-4912-8d95-2e87d0eed20d tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:30.834385 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ff8996b7-aac1-4912-8d95-2e87d0eed20d tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:30.843071 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ff8996b7-aac1-4912-8d95-2e87d0eed20d tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a" status: 200 len: 1314 microversion: 2.1 time: 0.423376 Oct 12 18:27:30.843673 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 135/264] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:30 2021] GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:30.853762 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-1c069d3b-d426-4d57-a7c0-773f02ae8e1a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:30.861725 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-1c069d3b-d426-4d57-a7c0-773f02ae8e1a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1516 microversion: 2.1 time: 0.444932 Oct 12 18:27:30.862998 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 130/265] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:30 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1516 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:30.879729 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-bd0d157e-f772-4dac-8136-85e01d81e141 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:30.880991 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-bd0d157e-f772-4dac-8136-85e01d81e141 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:30.887022 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bd0d157e-f772-4dac-8136-85e01d81e141 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:30.893071 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bd0d157e-f772-4dac-8136-85e01d81e141 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:30.893071 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bd0d157e-f772-4dac-8136-85e01d81e141 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:30.893071 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bd0d157e-f772-4dac-8136-85e01d81e141 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:30.915532 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-bd0d157e-f772-4dac-8136-85e01d81e141 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lazy-loading 'flavor' on Instance uuid 40b9689f-c878-4777-b81b-976434249834 {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:27:31.196445 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-3730d111-4181-41ff-ace0-f3a093ff4c2b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:31.197950 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-3730d111-4181-41ff-ace0-f3a093ff4c2b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:31.204036 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3730d111-4181-41ff-ace0-f3a093ff4c2b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:31.205082 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3730d111-4181-41ff-ace0-f3a093ff4c2b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:31.205869 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3730d111-4181-41ff-ace0-f3a093ff4c2b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:31.206291 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3730d111-4181-41ff-ace0-f3a093ff4c2b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:31.295580 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-bd0d157e-f772-4dac-8136-85e01d81e141 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "POST /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834/action" status: 200 len: 32 microversion: 2.1 time: 0.419015 Oct 12 18:27:31.297396 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 136/266] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:30 2021] POST /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834/action => generated 32 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 18:27:31.304191 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0da79ed9-1261-432c-afae-17dc84c665c8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:31.305275 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0da79ed9-1261-432c-afae-17dc84c665c8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:31.311823 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0da79ed9-1261-432c-afae-17dc84c665c8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:31.312391 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0da79ed9-1261-432c-afae-17dc84c665c8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:31.313360 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0da79ed9-1261-432c-afae-17dc84c665c8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:31.314388 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0da79ed9-1261-432c-afae-17dc84c665c8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:34.389248 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0da79ed9-1261-432c-afae-17dc84c665c8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28480 microversion: 2.20 time: 3.089970 Oct 12 18:27:34.390044 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 137/267] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:31 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28480 bytes in 3092 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:27:34.396167 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7456cae7-c23b-41c1-b96a-2727096e8c02 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:34.397069 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7456cae7-c23b-41c1-b96a-2727096e8c02 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:34.401018 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-3730d111-4181-41ff-ace0-f3a093ff4c2b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 3.205159 Oct 12 18:27:34.405110 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 131/268] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:31 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 3212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:27:34.407881 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-3bfbfe5b-15f5-4666-8986-5c83b712db71 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:34.408692 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-3bfbfe5b-15f5-4666-8986-5c83b712db71 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: 7248b1cd-5fb8-47c6-a410-5538946ca79a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:34.411860 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7456cae7-c23b-41c1-b96a-2727096e8c02 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:34.412303 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7456cae7-c23b-41c1-b96a-2727096e8c02 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:34.413131 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7456cae7-c23b-41c1-b96a-2727096e8c02 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:34.413560 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7456cae7-c23b-41c1-b96a-2727096e8c02 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:34.415845 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3bfbfe5b-15f5-4666-8986-5c83b712db71 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:34.416365 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3bfbfe5b-15f5-4666-8986-5c83b712db71 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:34.422390 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3bfbfe5b-15f5-4666-8986-5c83b712db71 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:34.422390 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3bfbfe5b-15f5-4666-8986-5c83b712db71 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:34.594047 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-3bfbfe5b-15f5-4666-8986-5c83b712db71 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:34.601013 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7456cae7-c23b-41c1-b96a-2727096e8c02 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:34.603585 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-3bfbfe5b-15f5-4666-8986-5c83b712db71 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a" status: 200 len: 1314 microversion: 2.1 time: 0.200500 Oct 12 18:27:34.604304 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 132/269] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:34 2021] GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:34.608974 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7456cae7-c23b-41c1-b96a-2727096e8c02 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1522 microversion: 2.1 time: 0.217688 Oct 12 18:27:34.609837 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 138/270] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:34 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:34.622085 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-4a90bb5f-db9c-438a-8f49-d5ccd5145099 req-09aa8bba-570f-40ad-9932-70e6bf38ea3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7248b1cd-5fb8-47c6-a410-5538946ca79a", "name": "network-vif-plugged", "status": "completed", "tag": "bd84017e-938d-4387-96eb-f90e80ff8a30"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:34.623634 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:27:34.623634 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:27:34.630908 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-4a90bb5f-db9c-438a-8f49-d5ccd5145099 req-09aa8bba-570f-40ad-9932-70e6bf38ea3c service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:34.631350 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-4a90bb5f-db9c-438a-8f49-d5ccd5145099 req-09aa8bba-570f-40ad-9932-70e6bf38ea3c service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:34.642801 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-4a90bb5f-db9c-438a-8f49-d5ccd5145099 req-09aa8bba-570f-40ad-9932-70e6bf38ea3c service nova] Creating event network-vif-plugged:bd84017e-938d-4387-96eb-f90e80ff8a30 for instance 7248b1cd-5fb8-47c6-a410-5538946ca79a on hv-cinder-81322 Oct 12 18:27:34.647565 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-4a90bb5f-db9c-438a-8f49-d5ccd5145099 req-09aa8bba-570f-40ad-9932-70e6bf38ea3c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033828 Oct 12 18:27:34.648155 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 133/271] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:27:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:27:35.402377 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3bb3958f-ce55-48e1-a338-40cbd6a969d1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:35.403247 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3bb3958f-ce55-48e1-a338-40cbd6a969d1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:35.409677 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3bb3958f-ce55-48e1-a338-40cbd6a969d1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:35.410111 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3bb3958f-ce55-48e1-a338-40cbd6a969d1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:35.410929 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3bb3958f-ce55-48e1-a338-40cbd6a969d1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:35.411359 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3bb3958f-ce55-48e1-a338-40cbd6a969d1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:35.413003 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-64725ec3-bc1c-42ae-b0cf-1c4891f13ee8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:35.414017 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-64725ec3-bc1c-42ae-b0cf-1c4891f13ee8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:35.420373 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-64725ec3-bc1c-42ae-b0cf-1c4891f13ee8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:35.420839 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-64725ec3-bc1c-42ae-b0cf-1c4891f13ee8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:35.421592 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-64725ec3-bc1c-42ae-b0cf-1c4891f13ee8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:35.422015 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-64725ec3-bc1c-42ae-b0cf-1c4891f13ee8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:35.564599 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3bb3958f-ce55-48e1-a338-40cbd6a969d1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28480 microversion: 2.20 time: 0.166038 Oct 12 18:27:35.565349 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 139/272] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:35 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28480 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:27:35.603539 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-64725ec3-bc1c-42ae-b0cf-1c4891f13ee8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.194151 Oct 12 18:27:35.605356 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 134/273] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:35 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:27:35.620000 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-447b79c5-168a-4835-9f5f-0d343e8fb7f9 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:35.620615 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-447b79c5-168a-4835-9f5f-0d343e8fb7f9 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: 7248b1cd-5fb8-47c6-a410-5538946ca79a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:35.626402 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-d3819714-5bd9-4f48-a7db-949bdcc0fea8 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:35.627289 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-447b79c5-168a-4835-9f5f-0d343e8fb7f9 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:35.627409 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-d3819714-5bd9-4f48-a7db-949bdcc0fea8 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:35.627733 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-447b79c5-168a-4835-9f5f-0d343e8fb7f9 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:35.628535 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-447b79c5-168a-4835-9f5f-0d343e8fb7f9 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:35.628976 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-447b79c5-168a-4835-9f5f-0d343e8fb7f9 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:35.633830 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d3819714-5bd9-4f48-a7db-949bdcc0fea8 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:35.634272 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d3819714-5bd9-4f48-a7db-949bdcc0fea8 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:35.635033 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d3819714-5bd9-4f48-a7db-949bdcc0fea8 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:35.635454 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d3819714-5bd9-4f48-a7db-949bdcc0fea8 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:35.810686 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-447b79c5-168a-4835-9f5f-0d343e8fb7f9 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:35.815122 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-d3819714-5bd9-4f48-a7db-949bdcc0fea8 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:35.818311 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-447b79c5-168a-4835-9f5f-0d343e8fb7f9 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a" status: 200 len: 1314 microversion: 2.1 time: 0.202350 Oct 12 18:27:35.818856 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 140/274] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:35 2021] GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:35.822723 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-d3819714-5bd9-4f48-a7db-949bdcc0fea8 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1522 microversion: 2.1 time: 0.200318 Oct 12 18:27:35.823372 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 135/275] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:35 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:27:36.576562 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e2f3cebc-9d4c-4f44-9364-08220cf257c1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:36.577467 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e2f3cebc-9d4c-4f44-9364-08220cf257c1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:36.583357 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e2f3cebc-9d4c-4f44-9364-08220cf257c1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:36.583803 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e2f3cebc-9d4c-4f44-9364-08220cf257c1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:36.584598 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e2f3cebc-9d4c-4f44-9364-08220cf257c1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:36.585037 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e2f3cebc-9d4c-4f44-9364-08220cf257c1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:36.615574 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-a75622c4-136d-481d-8a15-59e604543c97 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:36.616533 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-a75622c4-136d-481d-8a15-59e604543c97 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:36.622547 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a75622c4-136d-481d-8a15-59e604543c97 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:36.622985 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a75622c4-136d-481d-8a15-59e604543c97 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:36.623764 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a75622c4-136d-481d-8a15-59e604543c97 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:36.624191 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a75622c4-136d-481d-8a15-59e604543c97 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:36.701225 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e2f3cebc-9d4c-4f44-9364-08220cf257c1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28661 microversion: 2.20 time: 0.128200 Oct 12 18:27:36.702053 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 141/276] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:36 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28661 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:27:36.722815 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-a75622c4-136d-481d-8a15-59e604543c97 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.111354 Oct 12 18:27:36.723471 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 136/277] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:36 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:27:36.835407 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ed33efcc-6e9c-4c73-b879-5851320dff19 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:36.836004 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ed33efcc-6e9c-4c73-b879-5851320dff19 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: 7248b1cd-5fb8-47c6-a410-5538946ca79a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:36.840538 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c9f87f7e-ad79-4f81-8989-366ea6e4f251 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:36.841253 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c9f87f7e-ad79-4f81-8989-366ea6e4f251 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:36.843945 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ed33efcc-6e9c-4c73-b879-5851320dff19 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:36.844717 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ed33efcc-6e9c-4c73-b879-5851320dff19 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:36.845616 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ed33efcc-6e9c-4c73-b879-5851320dff19 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:36.846143 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ed33efcc-6e9c-4c73-b879-5851320dff19 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:36.847598 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c9f87f7e-ad79-4f81-8989-366ea6e4f251 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:36.848047 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c9f87f7e-ad79-4f81-8989-366ea6e4f251 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:36.848865 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c9f87f7e-ad79-4f81-8989-366ea6e4f251 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:36.849299 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c9f87f7e-ad79-4f81-8989-366ea6e4f251 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:37.040083 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c9f87f7e-ad79-4f81-8989-366ea6e4f251 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:37.043138 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ed33efcc-6e9c-4c73-b879-5851320dff19 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:37.047406 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c9f87f7e-ad79-4f81-8989-366ea6e4f251 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1522 microversion: 2.1 time: 0.210898 Oct 12 18:27:37.047958 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 137/278] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:36 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:27:37.051518 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ed33efcc-6e9c-4c73-b879-5851320dff19 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a" status: 200 len: 1314 microversion: 2.1 time: 0.220142 Oct 12 18:27:37.052073 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 142/279] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:36 2021] GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:37.713217 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-469d0470-f90c-4725-873c-41161ecb7636 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:37.714124 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-469d0470-f90c-4725-873c-41161ecb7636 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:37.719922 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-469d0470-f90c-4725-873c-41161ecb7636 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:37.720365 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-469d0470-f90c-4725-873c-41161ecb7636 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:37.721665 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-469d0470-f90c-4725-873c-41161ecb7636 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:37.722089 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-469d0470-f90c-4725-873c-41161ecb7636 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:37.734633 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e99a0242-9356-4626-9470-b383b34cf5ed tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:37.735621 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e99a0242-9356-4626-9470-b383b34cf5ed tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:37.741843 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e99a0242-9356-4626-9470-b383b34cf5ed tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:37.742280 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e99a0242-9356-4626-9470-b383b34cf5ed tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:37.743038 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e99a0242-9356-4626-9470-b383b34cf5ed tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:37.743461 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e99a0242-9356-4626-9470-b383b34cf5ed tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:37.808095 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-469d0470-f90c-4725-873c-41161ecb7636 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 0.098250 Oct 12 18:27:37.808805 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 138/280] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:37 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:27:37.825984 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e99a0242-9356-4626-9470-b383b34cf5ed tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.094842 Oct 12 18:27:37.826667 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 143/281] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:37 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:27:38.067726 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-af0f4901-45c2-4418-9ddd-234bf8062135 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:38.067726 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-af0f4901-45c2-4418-9ddd-234bf8062135 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:38.073029 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-af0f4901-45c2-4418-9ddd-234bf8062135 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:38.073476 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-af0f4901-45c2-4418-9ddd-234bf8062135 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:38.074254 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-af0f4901-45c2-4418-9ddd-234bf8062135 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:38.074685 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-af0f4901-45c2-4418-9ddd-234bf8062135 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:38.076268 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-fd8eaebc-4321-4c28-b356-6e80595bbd20 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:38.077183 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-fd8eaebc-4321-4c28-b356-6e80595bbd20 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: 7248b1cd-5fb8-47c6-a410-5538946ca79a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:38.084482 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fd8eaebc-4321-4c28-b356-6e80595bbd20 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:38.084926 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fd8eaebc-4321-4c28-b356-6e80595bbd20 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:38.085705 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fd8eaebc-4321-4c28-b356-6e80595bbd20 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:38.086128 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fd8eaebc-4321-4c28-b356-6e80595bbd20 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:38.264759 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-af0f4901-45c2-4418-9ddd-234bf8062135 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:38.273503 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-af0f4901-45c2-4418-9ddd-234bf8062135 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1522 microversion: 2.1 time: 0.211760 Oct 12 18:27:38.273753 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-fd8eaebc-4321-4c28-b356-6e80595bbd20 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:38.280439 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 139/282] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:38 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:38.282016 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-fd8eaebc-4321-4c28-b356-6e80595bbd20 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a" status: 200 len: 1497 microversion: 2.1 time: 0.209580 Oct 12 18:27:38.282806 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 144/283] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:38 2021] GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a => generated 1497 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:38.819435 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-4e152d9e-edf4-44a6-bb57-b587d13f0d0e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:38.821053 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-4e152d9e-edf4-44a6-bb57-b587d13f0d0e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:38.826394 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4e152d9e-edf4-44a6-bb57-b587d13f0d0e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:38.826781 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4e152d9e-edf4-44a6-bb57-b587d13f0d0e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:38.827552 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4e152d9e-edf4-44a6-bb57-b587d13f0d0e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:38.827987 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4e152d9e-edf4-44a6-bb57-b587d13f0d0e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:38.837926 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0b39767f-1c1a-4a18-a3cd-dd1ec928282e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:38.839896 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0b39767f-1c1a-4a18-a3cd-dd1ec928282e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:38.846964 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0b39767f-1c1a-4a18-a3cd-dd1ec928282e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:38.847755 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0b39767f-1c1a-4a18-a3cd-dd1ec928282e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:38.848827 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0b39767f-1c1a-4a18-a3cd-dd1ec928282e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:38.849474 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0b39767f-1c1a-4a18-a3cd-dd1ec928282e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:38.921993 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0b39767f-1c1a-4a18-a3cd-dd1ec928282e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.087780 Oct 12 18:27:38.922793 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 145/284] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:38 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:27:39.037498 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-4e152d9e-edf4-44a6-bb57-b587d13f0d0e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 0.221500 Oct 12 18:27:39.041577 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 140/285] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:38 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:27:39.291075 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c8f4a529-3feb-4fbe-8969-1a01f43eaa05 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:39.291871 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c8f4a529-3feb-4fbe-8969-1a01f43eaa05 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:39.298441 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c8f4a529-3feb-4fbe-8969-1a01f43eaa05 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:39.299507 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c8f4a529-3feb-4fbe-8969-1a01f43eaa05 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:39.300286 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c8f4a529-3feb-4fbe-8969-1a01f43eaa05 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:39.300742 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c8f4a529-3feb-4fbe-8969-1a01f43eaa05 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:39.426796 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c8f4a529-3feb-4fbe-8969-1a01f43eaa05 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:39.434079 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c8f4a529-3feb-4fbe-8969-1a01f43eaa05 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1522 microversion: 2.1 time: 0.147173 Oct 12 18:27:39.434641 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 146/286] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:39 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:39.935785 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-57bacc9e-4d30-483d-a6f9-5dee79e53692 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:39.936757 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-57bacc9e-4d30-483d-a6f9-5dee79e53692 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:39.943807 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-57bacc9e-4d30-483d-a6f9-5dee79e53692 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:39.944246 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-57bacc9e-4d30-483d-a6f9-5dee79e53692 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:39.945041 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-57bacc9e-4d30-483d-a6f9-5dee79e53692 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:39.945459 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-57bacc9e-4d30-483d-a6f9-5dee79e53692 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:40.006573 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-de8e09e0-adbe-4693-bd45-754113845b73 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:40.007094 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-de8e09e0-adbe-4693-bd45-754113845b73 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: 7248b1cd-5fb8-47c6-a410-5538946ca79a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:40.007203 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-57bacc9e-4d30-483d-a6f9-5dee79e53692 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.075503 Oct 12 18:27:40.008037 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 141/287] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:39 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:27:40.013193 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-de8e09e0-adbe-4693-bd45-754113845b73 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:40.013641 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-de8e09e0-adbe-4693-bd45-754113845b73 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:40.014413 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-de8e09e0-adbe-4693-bd45-754113845b73 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:40.014850 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-de8e09e0-adbe-4693-bd45-754113845b73 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:40.050558 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-76041f6d-8234-4081-87e4-61677cf589a0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:40.051762 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-76041f6d-8234-4081-87e4-61677cf589a0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:40.058707 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-76041f6d-8234-4081-87e4-61677cf589a0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:40.059155 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-76041f6d-8234-4081-87e4-61677cf589a0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:40.059952 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-76041f6d-8234-4081-87e4-61677cf589a0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:40.060382 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-76041f6d-8234-4081-87e4-61677cf589a0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:40.181359 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-de8e09e0-adbe-4693-bd45-754113845b73 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: 7248b1cd-5fb8-47c6-a410-5538946ca79a] Going to try to terminate instance {{(pid=109168) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 18:27:40.485542 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-de8e09e0-adbe-4693-bd45-754113845b73 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a" status: 204 len: 0 microversion: 2.1 time: 0.482682 Oct 12 18:27:40.486127 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 147/288] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Oct 12 18:27:40 2021] DELETE /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 18:27:40.491558 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-22097820-d511-4b04-b8cb-cf7aefa28d9e tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:40.492233 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-22097820-d511-4b04-b8cb-cf7aefa28d9e tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:40.497918 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-22097820-d511-4b04-b8cb-cf7aefa28d9e tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:40.498373 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-22097820-d511-4b04-b8cb-cf7aefa28d9e tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:40.499141 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-22097820-d511-4b04-b8cb-cf7aefa28d9e tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:40.499573 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-22097820-d511-4b04-b8cb-cf7aefa28d9e tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:40.619904 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-22097820-d511-4b04-b8cb-cf7aefa28d9e tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:40.629594 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-22097820-d511-4b04-b8cb-cf7aefa28d9e tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1522 microversion: 2.1 time: 0.141761 Oct 12 18:27:40.630170 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 148/289] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:40 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1522 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:40.634436 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8021c7bf-d2b5-4bdb-861c-52c81b35e374 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:40.635067 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8021c7bf-d2b5-4bdb-861c-52c81b35e374 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: 7248b1cd-5fb8-47c6-a410-5538946ca79a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:40.641182 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8021c7bf-d2b5-4bdb-861c-52c81b35e374 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:40.641633 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8021c7bf-d2b5-4bdb-861c-52c81b35e374 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:40.642474 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8021c7bf-d2b5-4bdb-861c-52c81b35e374 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:40.642915 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8021c7bf-d2b5-4bdb-861c-52c81b35e374 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:40.769130 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8021c7bf-d2b5-4bdb-861c-52c81b35e374 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:40.776756 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8021c7bf-d2b5-4bdb-861c-52c81b35e374 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a" status: 200 len: 1503 microversion: 2.1 time: 0.145532 Oct 12 18:27:40.777452 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 149/290] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:40 2021] GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a => generated 1503 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:41.019007 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-6b2e070e-4fc7-4cec-a4a8-dc516a75e738 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:41.019926 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-6b2e070e-4fc7-4cec-a4a8-dc516a75e738 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:41.026020 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6b2e070e-4fc7-4cec-a4a8-dc516a75e738 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:41.026459 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6b2e070e-4fc7-4cec-a4a8-dc516a75e738 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:41.027309 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6b2e070e-4fc7-4cec-a4a8-dc516a75e738 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:41.027766 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6b2e070e-4fc7-4cec-a4a8-dc516a75e738 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:42.332919 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-76041f6d-8234-4081-87e4-61677cf589a0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 2.286811 Oct 12 18:27:42.333547 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 142/291] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:40 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 2289 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:27:42.338496 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-e2062725-fdd4-4d3b-9846-d5194ad31fe4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:42.339190 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-e2062725-fdd4-4d3b-9846-d5194ad31fe4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:42.346245 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e2062725-fdd4-4d3b-9846-d5194ad31fe4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:42.346686 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e2062725-fdd4-4d3b-9846-d5194ad31fe4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:42.347461 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e2062725-fdd4-4d3b-9846-d5194ad31fe4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:42.347891 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e2062725-fdd4-4d3b-9846-d5194ad31fe4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:42.470991 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-e2062725-fdd4-4d3b-9846-d5194ad31fe4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:42.478621 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-e2062725-fdd4-4d3b-9846-d5194ad31fe4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1522 microversion: 2.1 time: 0.143800 Oct 12 18:27:42.479040 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 143/292] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:42 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:42.483258 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-33524394-6ca2-4159-b77f-4fe09f45d729 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:42.483866 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-33524394-6ca2-4159-b77f-4fe09f45d729 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: 7248b1cd-5fb8-47c6-a410-5538946ca79a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:42.489472 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-33524394-6ca2-4159-b77f-4fe09f45d729 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:42.489914 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-33524394-6ca2-4159-b77f-4fe09f45d729 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:42.490697 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-33524394-6ca2-4159-b77f-4fe09f45d729 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:42.491130 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-33524394-6ca2-4159-b77f-4fe09f45d729 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:42.613354 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-33524394-6ca2-4159-b77f-4fe09f45d729 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:42.617093 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-33524394-6ca2-4159-b77f-4fe09f45d729 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a" status: 200 len: 1503 microversion: 2.1 time: 0.137043 Oct 12 18:27:42.617682 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 144/293] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:42 2021] GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a => generated 1503 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:43.346287 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-5998d73a-d9c7-4d56-a7f9-e9bb68f606de tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:43.347334 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-5998d73a-d9c7-4d56-a7f9-e9bb68f606de tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:43.353579 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5998d73a-d9c7-4d56-a7f9-e9bb68f606de tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:43.354016 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5998d73a-d9c7-4d56-a7f9-e9bb68f606de tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:43.354776 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5998d73a-d9c7-4d56-a7f9-e9bb68f606de tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:43.355297 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5998d73a-d9c7-4d56-a7f9-e9bb68f606de tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:44.936074 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-6b2e070e-4fc7-4cec-a4a8-dc516a75e738 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 3.920696 Oct 12 18:27:44.936855 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 150/294] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:41 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 3922 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:27:44.941807 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-423592b5-939b-4229-b9e7-bbb30bd24b9d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:44.942510 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-423592b5-939b-4229-b9e7-bbb30bd24b9d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:44.947096 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-5998d73a-d9c7-4d56-a7f9-e9bb68f606de tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 1.604259 Oct 12 18:27:44.948932 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 145/295] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:43 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:27:44.952494 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-423592b5-939b-4229-b9e7-bbb30bd24b9d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:44.952494 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-423592b5-939b-4229-b9e7-bbb30bd24b9d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:44.952494 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-423592b5-939b-4229-b9e7-bbb30bd24b9d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:44.952494 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-423592b5-939b-4229-b9e7-bbb30bd24b9d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:44.960006 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-ba099786-e61f-472f-956a-3d4b6e9c5ac6 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:44.960826 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-ba099786-e61f-472f-956a-3d4b6e9c5ac6 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: 7248b1cd-5fb8-47c6-a410-5538946ca79a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:44.968191 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ba099786-e61f-472f-956a-3d4b6e9c5ac6 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:44.969470 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ba099786-e61f-472f-956a-3d4b6e9c5ac6 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:44.970263 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ba099786-e61f-472f-956a-3d4b6e9c5ac6 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:44.971283 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ba099786-e61f-472f-956a-3d4b6e9c5ac6 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:45.130749 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-423592b5-939b-4229-b9e7-bbb30bd24b9d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:45.138309 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-423592b5-939b-4229-b9e7-bbb30bd24b9d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1522 microversion: 2.1 time: 0.200417 Oct 12 18:27:45.145581 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 151/296] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:44 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:45.146393 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-ba099786-e61f-472f-956a-3d4b6e9c5ac6 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:45.154359 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-ba099786-e61f-472f-956a-3d4b6e9c5ac6 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a" status: 200 len: 1503 microversion: 2.1 time: 0.198441 Oct 12 18:27:45.154926 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 146/297] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:44 2021] GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a => generated 1503 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:45.948270 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3de698e7-d6c8-4e56-b5c1-78901b6aaf63 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:45.949207 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3de698e7-d6c8-4e56-b5c1-78901b6aaf63 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:45.956184 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3de698e7-d6c8-4e56-b5c1-78901b6aaf63 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:45.956800 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3de698e7-d6c8-4e56-b5c1-78901b6aaf63 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:45.957581 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3de698e7-d6c8-4e56-b5c1-78901b6aaf63 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:45.958011 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3de698e7-d6c8-4e56-b5c1-78901b6aaf63 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:45.959805 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-ff5f56ac-49b8-40d0-bdf2-8d963318ddda tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:45.961311 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-ff5f56ac-49b8-40d0-bdf2-8d963318ddda tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:45.969329 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ff5f56ac-49b8-40d0-bdf2-8d963318ddda tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:45.969329 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ff5f56ac-49b8-40d0-bdf2-8d963318ddda tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:45.969938 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ff5f56ac-49b8-40d0-bdf2-8d963318ddda tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:45.970865 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ff5f56ac-49b8-40d0-bdf2-8d963318ddda tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:46.047063 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3de698e7-d6c8-4e56-b5c1-78901b6aaf63 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.102215 Oct 12 18:27:46.047945 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 152/298] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:45 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:27:46.051581 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-ff5f56ac-49b8-40d0-bdf2-8d963318ddda tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 0.095635 Oct 12 18:27:46.053997 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 147/299] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:45 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:27:46.155977 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-12d308c4-7ecc-4ccc-8095-52b933b5a024 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:46.156717 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-12d308c4-7ecc-4ccc-8095-52b933b5a024 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:46.163863 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-12d308c4-7ecc-4ccc-8095-52b933b5a024 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:46.164312 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-12d308c4-7ecc-4ccc-8095-52b933b5a024 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:46.165114 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-12d308c4-7ecc-4ccc-8095-52b933b5a024 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:46.167315 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-12d308c4-7ecc-4ccc-8095-52b933b5a024 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:46.175422 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-dacc7e96-72fb-4b1c-ab27-fff65736e968 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:46.176030 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-dacc7e96-72fb-4b1c-ab27-fff65736e968 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: 7248b1cd-5fb8-47c6-a410-5538946ca79a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:46.183709 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-dacc7e96-72fb-4b1c-ab27-fff65736e968 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:46.184679 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-dacc7e96-72fb-4b1c-ab27-fff65736e968 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:46.185735 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-dacc7e96-72fb-4b1c-ab27-fff65736e968 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:46.186492 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-dacc7e96-72fb-4b1c-ab27-fff65736e968 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:46.349133 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-12d308c4-7ecc-4ccc-8095-52b933b5a024 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:46.356748 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-12d308c4-7ecc-4ccc-8095-52b933b5a024 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1522 microversion: 2.1 time: 0.204527 Oct 12 18:27:46.357367 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 153/300] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:46 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:46.369601 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-dacc7e96-72fb-4b1c-ab27-fff65736e968 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:46.378266 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-dacc7e96-72fb-4b1c-ab27-fff65736e968 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a" status: 200 len: 1503 microversion: 2.1 time: 0.208646 Oct 12 18:27:46.378830 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 148/301] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:46 2021] GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a => generated 1503 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:47.059178 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9ece7541-227f-4b1f-b54a-6dcbc3612b80 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:47.060419 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9ece7541-227f-4b1f-b54a-6dcbc3612b80 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:47.063195 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-31f473f6-bccf-40d6-b72e-f52849604ccc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:47.064811 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-31f473f6-bccf-40d6-b72e-f52849604ccc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:47.066961 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9ece7541-227f-4b1f-b54a-6dcbc3612b80 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:47.067401 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9ece7541-227f-4b1f-b54a-6dcbc3612b80 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:47.068191 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9ece7541-227f-4b1f-b54a-6dcbc3612b80 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:47.068648 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9ece7541-227f-4b1f-b54a-6dcbc3612b80 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:47.089393 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-31f473f6-bccf-40d6-b72e-f52849604ccc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:47.089841 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-31f473f6-bccf-40d6-b72e-f52849604ccc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:47.090621 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-31f473f6-bccf-40d6-b72e-f52849604ccc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:47.091048 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-31f473f6-bccf-40d6-b72e-f52849604ccc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:47.165810 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9ece7541-227f-4b1f-b54a-6dcbc3612b80 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.110287 Oct 12 18:27:47.166452 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 154/302] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:47 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:27:47.171823 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-31f473f6-bccf-40d6-b72e-f52849604ccc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 0.112107 Oct 12 18:27:47.172229 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 149/303] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:47 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:27:47.373963 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e3710504-8806-4af5-8fc1-07a70c03cbfc tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:47.374507 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e3710504-8806-4af5-8fc1-07a70c03cbfc tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:47.383295 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e3710504-8806-4af5-8fc1-07a70c03cbfc tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:47.384364 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e3710504-8806-4af5-8fc1-07a70c03cbfc tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:47.385391 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e3710504-8806-4af5-8fc1-07a70c03cbfc tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:47.386095 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e3710504-8806-4af5-8fc1-07a70c03cbfc tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:47.405288 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-0b501a41-5dc6-4517-8876-67b39b10528b tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:47.406055 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-0b501a41-5dc6-4517-8876-67b39b10528b tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: 7248b1cd-5fb8-47c6-a410-5538946ca79a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:47.414813 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0b501a41-5dc6-4517-8876-67b39b10528b tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:47.415263 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0b501a41-5dc6-4517-8876-67b39b10528b tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:47.416047 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0b501a41-5dc6-4517-8876-67b39b10528b tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:47.416546 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0b501a41-5dc6-4517-8876-67b39b10528b tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:47.552537 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e3710504-8806-4af5-8fc1-07a70c03cbfc tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:47.561888 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e3710504-8806-4af5-8fc1-07a70c03cbfc tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1522 microversion: 2.1 time: 0.191885 Oct 12 18:27:47.562582 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 155/304] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:47 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:47.600677 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-0b501a41-5dc6-4517-8876-67b39b10528b tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:47.607939 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-0b501a41-5dc6-4517-8876-67b39b10528b tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a" status: 200 len: 1503 microversion: 2.1 time: 0.209545 Oct 12 18:27:47.608514 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 150/305] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:47 2021] GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a => generated 1503 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:47.763005 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-8971e463-fb3f-4d41-8b74-48b15148d8c0 req-df025f2b-8331-4541-8566-2b1fbbce6372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7248b1cd-5fb8-47c6-a410-5538946ca79a", "name": "network-vif-deleted", "tag": "bd84017e-938d-4387-96eb-f90e80ff8a30"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:47.764697 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:27:47.764697 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:27:47.771972 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-8971e463-fb3f-4d41-8b74-48b15148d8c0 req-df025f2b-8331-4541-8566-2b1fbbce6372 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:47.772494 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-8971e463-fb3f-4d41-8b74-48b15148d8c0 req-df025f2b-8331-4541-8566-2b1fbbce6372 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:47.783720 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-8971e463-fb3f-4d41-8b74-48b15148d8c0 req-df025f2b-8331-4541-8566-2b1fbbce6372 service nova] Creating event network-vif-deleted:bd84017e-938d-4387-96eb-f90e80ff8a30 for instance 7248b1cd-5fb8-47c6-a410-5538946ca79a on hv-cinder-81322 Oct 12 18:27:47.800096 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-8971e463-fb3f-4d41-8b74-48b15148d8c0 req-df025f2b-8331-4541-8566-2b1fbbce6372 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031642 Oct 12 18:27:47.800096 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 156/306] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:27:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:27:48.177978 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-8ba009f4-7224-44f7-a13b-873762a49fca tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:48.179302 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-8ba009f4-7224-44f7-a13b-873762a49fca tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:48.185375 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8ba009f4-7224-44f7-a13b-873762a49fca tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:48.185816 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8ba009f4-7224-44f7-a13b-873762a49fca tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:48.186544 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5f716239-0c0a-42f2-87ba-9711e33109b5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:48.187007 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8ba009f4-7224-44f7-a13b-873762a49fca tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:48.187007 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8ba009f4-7224-44f7-a13b-873762a49fca tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:48.188055 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5f716239-0c0a-42f2-87ba-9711e33109b5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:48.195253 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5f716239-0c0a-42f2-87ba-9711e33109b5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:48.195839 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5f716239-0c0a-42f2-87ba-9711e33109b5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:48.196964 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5f716239-0c0a-42f2-87ba-9711e33109b5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:48.197480 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5f716239-0c0a-42f2-87ba-9711e33109b5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:48.280656 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-8ba009f4-7224-44f7-a13b-873762a49fca tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.106277 Oct 12 18:27:48.281336 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 151/307] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:48 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:27:48.285611 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5f716239-0c0a-42f2-87ba-9711e33109b5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 0.104496 Oct 12 18:27:48.289494 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 157/308] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:48 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:27:48.578328 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-77dbbab7-f5b9-4c44-9c44-662190246e47 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:48.579121 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-77dbbab7-f5b9-4c44-9c44-662190246e47 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:48.585926 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-77dbbab7-f5b9-4c44-9c44-662190246e47 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:48.592809 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-77dbbab7-f5b9-4c44-9c44-662190246e47 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:48.592809 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-77dbbab7-f5b9-4c44-9c44-662190246e47 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:48.592809 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-77dbbab7-f5b9-4c44-9c44-662190246e47 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:48.626453 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7d97378c-3954-4e74-9367-74e0ef2272b9 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:48.629308 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7d97378c-3954-4e74-9367-74e0ef2272b9 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: 7248b1cd-5fb8-47c6-a410-5538946ca79a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:48.638207 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7d97378c-3954-4e74-9367-74e0ef2272b9 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:48.638649 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7d97378c-3954-4e74-9367-74e0ef2272b9 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:48.639450 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7d97378c-3954-4e74-9367-74e0ef2272b9 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:48.639876 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7d97378c-3954-4e74-9367-74e0ef2272b9 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:48.671536 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7d97378c-3954-4e74-9367-74e0ef2272b9 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:48.673104 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7d97378c-3954-4e74-9367-74e0ef2272b9 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:48.673104 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-7d97378c-3954-4e74-9367-74e0ef2272b9 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lazy-loading 'fault' on Instance uuid 7248b1cd-5fb8-47c6-a410-5538946ca79a {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:27:48.722920 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7d97378c-3954-4e74-9367-74e0ef2272b9 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:48.730717 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7d97378c-3954-4e74-9367-74e0ef2272b9 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a" status: 200 len: 1304 microversion: 2.1 time: 0.108656 Oct 12 18:27:48.732975 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 158/309] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:48 2021] GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:48.744745 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-77dbbab7-f5b9-4c44-9c44-662190246e47 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:48.753071 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-77dbbab7-f5b9-4c44-9c44-662190246e47 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1522 microversion: 2.1 time: 0.178594 Oct 12 18:27:48.762599 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 152/310] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:48 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:49.292695 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-6a7de96b-9346-431c-860e-e8a666ead612 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:49.293645 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-6a7de96b-9346-431c-860e-e8a666ead612 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:49.297062 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-a48fa765-55fa-4c03-85b0-666abdd835e7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:49.298017 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-a48fa765-55fa-4c03-85b0-666abdd835e7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:49.300068 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6a7de96b-9346-431c-860e-e8a666ead612 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:49.300545 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6a7de96b-9346-431c-860e-e8a666ead612 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:49.301324 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6a7de96b-9346-431c-860e-e8a666ead612 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:49.301776 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6a7de96b-9346-431c-860e-e8a666ead612 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:49.304313 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a48fa765-55fa-4c03-85b0-666abdd835e7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:49.304806 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a48fa765-55fa-4c03-85b0-666abdd835e7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:49.305558 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a48fa765-55fa-4c03-85b0-666abdd835e7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:49.305981 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a48fa765-55fa-4c03-85b0-666abdd835e7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:49.371372 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-6a7de96b-9346-431c-860e-e8a666ead612 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.082310 Oct 12 18:27:49.371989 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 159/311] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:49 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:27:49.377155 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-a48fa765-55fa-4c03-85b0-666abdd835e7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 0.083539 Oct 12 18:27:49.377752 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 153/312] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:49 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:27:49.749418 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f79eea71-6c71-48d2-8f15-d4a22b4e93c8 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:49.750400 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f79eea71-6c71-48d2-8f15-d4a22b4e93c8 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: 7248b1cd-5fb8-47c6-a410-5538946ca79a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:49.757933 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f79eea71-6c71-48d2-8f15-d4a22b4e93c8 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:49.757933 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f79eea71-6c71-48d2-8f15-d4a22b4e93c8 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:49.758412 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f79eea71-6c71-48d2-8f15-d4a22b4e93c8 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:49.758852 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f79eea71-6c71-48d2-8f15-d4a22b4e93c8 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:49.769724 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-a711a9a4-7f62-4e43-a35a-8b115f349fbe tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:49.770426 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-a711a9a4-7f62-4e43-a35a-8b115f349fbe tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:49.773535 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-f79eea71-6c71-48d2-8f15-d4a22b4e93c8 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] HTTP exception thrown: Instance 7248b1cd-5fb8-47c6-a410-5538946ca79a could not be found. Oct 12 18:27:49.774315 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f79eea71-6c71-48d2-8f15-d4a22b4e93c8 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Returning 404 to user: Instance 7248b1cd-5fb8-47c6-a410-5538946ca79a could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:27:49.775254 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f79eea71-6c71-48d2-8f15-d4a22b4e93c8 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a" status: 404 len: 111 microversion: 2.1 time: 0.030208 Oct 12 18:27:49.776215 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 160/313] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:49 2021] GET /compute/v2.1/servers/7248b1cd-5fb8-47c6-a410-5538946ca79a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:27:49.778580 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a711a9a4-7f62-4e43-a35a-8b115f349fbe tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:49.779032 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a711a9a4-7f62-4e43-a35a-8b115f349fbe tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:49.787294 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a711a9a4-7f62-4e43-a35a-8b115f349fbe tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:49.787294 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a711a9a4-7f62-4e43-a35a-8b115f349fbe tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:49.908709 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9a660d4a-7cad-4ea3-af7c-f3b785210ffa tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1280886798", "imageRef": "c79f0511-74c5-46f3-a7e6-cde6b09234ee", "flavorRef": "452", "networks": [{"uuid": "0999fba4-b001-46c1-a95d-aa5cf57e9c09"}]}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:49.910478 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-a711a9a4-7f62-4e43-a35a-8b115f349fbe tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:49.919369 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-a711a9a4-7f62-4e43-a35a-8b115f349fbe tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1522 microversion: 2.1 time: 0.153692 Oct 12 18:27:49.927255 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 154/314] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:49 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:49.967588 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.network.neutron [None req-9a660d4a-7cad-4ea3-af7c-f3b785210ffa tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] validate_networks() for [('0999fba4-b001-46c1-a95d-aa5cf57e9c09', None, None, None, None, None)] {{(pid=109168) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 18:27:50.337281 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-9a660d4a-7cad-4ea3-af7c-f3b785210ffa tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Flavor limits 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 18:27:50.339040 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-9a660d4a-7cad-4ea3-af7c-f3b785210ffa tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Image limits 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 18:27:50.341370 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-9a660d4a-7cad-4ea3-af7c-f3b785210ffa tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Flavor pref 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 18:27:50.341973 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-9a660d4a-7cad-4ea3-af7c-f3b785210ffa tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Image pref 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 18:27:50.342844 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-9a660d4a-7cad-4ea3-af7c-f3b785210ffa tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 18:27:50.354603 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9a660d4a-7cad-4ea3-af7c-f3b785210ffa tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:50.355048 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9a660d4a-7cad-4ea3-af7c-f3b785210ffa tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:50.355841 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9a660d4a-7cad-4ea3-af7c-f3b785210ffa tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:50.356469 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9a660d4a-7cad-4ea3-af7c-f3b785210ffa tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:50.373145 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-9a660d4a-7cad-4ea3-af7c-f3b785210ffa tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Getting quotas for project ec6b4ea245ba455cb3a788ef7907c669. Resources: {'instances', 'cores', 'ram'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:27:50.379779 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-9a660d4a-7cad-4ea3-af7c-f3b785210ffa tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Getting quotas for user ac7aaed40f314bf397c414162affa8ad and project ec6b4ea245ba455cb3a788ef7907c669. Resources: {'instances', 'cores', 'ram'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:27:50.383514 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-3021d013-0bf2-49d1-ae13-aca504c9651f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:50.384482 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-3021d013-0bf2-49d1-ae13-aca504c9651f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:50.390749 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3021d013-0bf2-49d1-ae13-aca504c9651f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:50.391200 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3021d013-0bf2-49d1-ae13-aca504c9651f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:50.392305 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3021d013-0bf2-49d1-ae13-aca504c9651f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:50.392769 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3021d013-0bf2-49d1-ae13-aca504c9651f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:50.392880 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9a660d4a-7cad-4ea3-af7c-f3b785210ffa tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Going to run 1 instances... {{(pid=109168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 18:27:50.395197 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9a660d4a-7cad-4ea3-af7c-f3b785210ffa tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: d837950a-354a-44a9-9796-2049507a2225] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c79f0511-74c5-46f3-a7e6-cde6b09234ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 18:27:50.485653 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-3021d013-0bf2-49d1-ae13-aca504c9651f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.105917 Oct 12 18:27:50.486928 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 155/315] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:50 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:27:50.492583 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-ed27b9fd-15fe-48a9-b068-53e6c6c0c550 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:50.492766 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-ed27b9fd-15fe-48a9-b068-53e6c6c0c550 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:50.501068 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ed27b9fd-15fe-48a9-b068-53e6c6c0c550 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:50.501709 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ed27b9fd-15fe-48a9-b068-53e6c6c0c550 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:50.502487 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ed27b9fd-15fe-48a9-b068-53e6c6c0c550 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:50.502917 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ed27b9fd-15fe-48a9-b068-53e6c6c0c550 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:50.523726 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9a660d4a-7cad-4ea3-af7c-f3b785210ffa tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.619148 Oct 12 18:27:50.524363 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 161/316] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Oct 12 18:27:49 2021] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 18:27:50.537287 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-41ee1d6b-cb9b-4094-83a1-9e3e691e5ae9 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:50.537834 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-41ee1d6b-cb9b-4094-83a1-9e3e691e5ae9 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: d837950a-354a-44a9-9796-2049507a2225] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:50.575590 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-ed27b9fd-15fe-48a9-b068-53e6c6c0c550 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 0.081581 Oct 12 18:27:50.579524 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 156/317] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:50 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:27:50.632969 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-41ee1d6b-cb9b-4094-83a1-9e3e691e5ae9 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:50.640488 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-41ee1d6b-cb9b-4094-83a1-9e3e691e5ae9 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225" status: 200 len: 1214 microversion: 2.1 time: 0.107391 Oct 12 18:27:50.641494 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 162/318] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:50 2021] GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225 => generated 1214 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:50.938765 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-fde12299-678c-4b4a-b49f-cb0a359b2cd3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:50.940141 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-fde12299-678c-4b4a-b49f-cb0a359b2cd3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:50.950331 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fde12299-678c-4b4a-b49f-cb0a359b2cd3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:50.950985 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fde12299-678c-4b4a-b49f-cb0a359b2cd3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:50.951702 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fde12299-678c-4b4a-b49f-cb0a359b2cd3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:50.952161 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fde12299-678c-4b4a-b49f-cb0a359b2cd3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:51.139044 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-fde12299-678c-4b4a-b49f-cb0a359b2cd3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:51.147773 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-fde12299-678c-4b4a-b49f-cb0a359b2cd3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1522 microversion: 2.1 time: 0.214309 Oct 12 18:27:51.148345 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 157/319] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:50 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:51.498202 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-12944a47-80f8-4afd-a162-6b9c3eeeaa77 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:51.499154 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-12944a47-80f8-4afd-a162-6b9c3eeeaa77 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:51.507597 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-12944a47-80f8-4afd-a162-6b9c3eeeaa77 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:51.508236 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-12944a47-80f8-4afd-a162-6b9c3eeeaa77 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:51.508951 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-12944a47-80f8-4afd-a162-6b9c3eeeaa77 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:51.509387 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-12944a47-80f8-4afd-a162-6b9c3eeeaa77 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:51.591353 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-e67a991f-361e-4966-99e8-99716212447c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:51.592480 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-e67a991f-361e-4966-99e8-99716212447c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:51.598811 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e67a991f-361e-4966-99e8-99716212447c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:51.599252 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e67a991f-361e-4966-99e8-99716212447c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:51.600039 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e67a991f-361e-4966-99e8-99716212447c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:51.600501 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e67a991f-361e-4966-99e8-99716212447c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:54.264007 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-12944a47-80f8-4afd-a162-6b9c3eeeaa77 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 2.769443 Oct 12 18:27:54.264748 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 163/320] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:51 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 2771 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:27:54.270455 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-e67a991f-361e-4966-99e8-99716212447c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 2.682233 Oct 12 18:27:54.274706 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 158/321] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:51 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 2685 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:27:54.274855 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-deee8df8-fbf8-44f1-a2e9-0f9a88bd659a tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:54.274855 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-deee8df8-fbf8-44f1-a2e9-0f9a88bd659a tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: d837950a-354a-44a9-9796-2049507a2225] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:54.278047 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-140f7ccb-6196-4385-aeee-ea206ecb06c3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:54.279387 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-140f7ccb-6196-4385-aeee-ea206ecb06c3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:54.281110 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-deee8df8-fbf8-44f1-a2e9-0f9a88bd659a tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:54.281668 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-deee8df8-fbf8-44f1-a2e9-0f9a88bd659a tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:54.282454 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-deee8df8-fbf8-44f1-a2e9-0f9a88bd659a tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:54.283519 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-deee8df8-fbf8-44f1-a2e9-0f9a88bd659a tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:54.289280 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-140f7ccb-6196-4385-aeee-ea206ecb06c3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:54.352535 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-140f7ccb-6196-4385-aeee-ea206ecb06c3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:54.352535 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-140f7ccb-6196-4385-aeee-ea206ecb06c3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:54.352535 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-140f7ccb-6196-4385-aeee-ea206ecb06c3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:54.398583 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-deee8df8-fbf8-44f1-a2e9-0f9a88bd659a tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:54.407099 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-deee8df8-fbf8-44f1-a2e9-0f9a88bd659a tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225" status: 200 len: 1218 microversion: 2.1 time: 0.141171 Oct 12 18:27:54.408008 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 164/322] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:54 2021] GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225 => generated 1218 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:54.568758 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-140f7ccb-6196-4385-aeee-ea206ecb06c3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:54.577654 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-140f7ccb-6196-4385-aeee-ea206ecb06c3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1522 microversion: 2.1 time: 0.304951 Oct 12 18:27:54.578224 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 159/323] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:54 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:55.276806 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-37243f77-a477-4767-b5b0-dd83622d2a06 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:55.282112 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-37243f77-a477-4767-b5b0-dd83622d2a06 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:55.285674 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-86a64fd5-c182-464f-8c93-fd69eb39fb20 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:55.285674 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-86a64fd5-c182-464f-8c93-fd69eb39fb20 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:55.295713 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-37243f77-a477-4767-b5b0-dd83622d2a06 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:55.296509 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-37243f77-a477-4767-b5b0-dd83622d2a06 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:55.300276 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-37243f77-a477-4767-b5b0-dd83622d2a06 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:55.302483 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-37243f77-a477-4767-b5b0-dd83622d2a06 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:55.302991 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-86a64fd5-c182-464f-8c93-fd69eb39fb20 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:55.303636 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-86a64fd5-c182-464f-8c93-fd69eb39fb20 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:55.304673 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-86a64fd5-c182-464f-8c93-fd69eb39fb20 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:55.308078 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-86a64fd5-c182-464f-8c93-fd69eb39fb20 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:55.411392 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-37243f77-a477-4767-b5b0-dd83622d2a06 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.136590 Oct 12 18:27:55.411737 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-86a64fd5-c182-464f-8c93-fd69eb39fb20 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 0.132389 Oct 12 18:27:55.412913 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 160/324] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:55 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:27:55.417301 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 165/325] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:55 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:27:55.427516 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-29477277-8187-4eac-9a53-01c9c655ec91 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:55.428684 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-29477277-8187-4eac-9a53-01c9c655ec91 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: d837950a-354a-44a9-9796-2049507a2225] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:55.438968 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-29477277-8187-4eac-9a53-01c9c655ec91 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:55.439509 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-29477277-8187-4eac-9a53-01c9c655ec91 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:55.440371 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-29477277-8187-4eac-9a53-01c9c655ec91 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:55.441056 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-29477277-8187-4eac-9a53-01c9c655ec91 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:55.599032 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f16aaee7-1b17-41d2-ae3a-865cb4894e9a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:55.604006 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f16aaee7-1b17-41d2-ae3a-865cb4894e9a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:55.609199 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f16aaee7-1b17-41d2-ae3a-865cb4894e9a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:55.618055 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f16aaee7-1b17-41d2-ae3a-865cb4894e9a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:55.620096 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f16aaee7-1b17-41d2-ae3a-865cb4894e9a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:55.636087 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f16aaee7-1b17-41d2-ae3a-865cb4894e9a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:55.702791 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-29477277-8187-4eac-9a53-01c9c655ec91 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:55.711205 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-29477277-8187-4eac-9a53-01c9c655ec91 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225" status: 200 len: 1266 microversion: 2.1 time: 0.287628 Oct 12 18:27:55.711793 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 161/326] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:55 2021] GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225 => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:55.850364 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f16aaee7-1b17-41d2-ae3a-865cb4894e9a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:55.858995 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f16aaee7-1b17-41d2-ae3a-865cb4894e9a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1522 microversion: 2.1 time: 0.267529 Oct 12 18:27:55.859962 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 166/327] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:55 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:56.424261 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-84c7f9a5-cd14-4dea-9d7e-07c65657c35f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:56.429727 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4bcfbe38-56ac-4569-9651-d20dbb55e850 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:56.431386 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4bcfbe38-56ac-4569-9651-d20dbb55e850 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:56.435261 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-84c7f9a5-cd14-4dea-9d7e-07c65657c35f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:56.445471 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4bcfbe38-56ac-4569-9651-d20dbb55e850 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:56.447779 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-84c7f9a5-cd14-4dea-9d7e-07c65657c35f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:56.451679 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4bcfbe38-56ac-4569-9651-d20dbb55e850 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:56.451679 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4bcfbe38-56ac-4569-9651-d20dbb55e850 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:56.451679 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4bcfbe38-56ac-4569-9651-d20dbb55e850 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:56.452719 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-84c7f9a5-cd14-4dea-9d7e-07c65657c35f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:56.453919 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-84c7f9a5-cd14-4dea-9d7e-07c65657c35f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:56.454541 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-84c7f9a5-cd14-4dea-9d7e-07c65657c35f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:56.548621 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4bcfbe38-56ac-4569-9651-d20dbb55e850 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.121481 Oct 12 18:27:56.555584 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 167/328] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:56 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:27:56.563504 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-84c7f9a5-cd14-4dea-9d7e-07c65657c35f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 0.143371 Oct 12 18:27:56.564860 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 162/329] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:56 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:27:56.731437 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7a961f12-43a9-407f-8099-1b45bbc924bc tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:56.733069 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7a961f12-43a9-407f-8099-1b45bbc924bc tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: d837950a-354a-44a9-9796-2049507a2225] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:56.742311 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7a961f12-43a9-407f-8099-1b45bbc924bc tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:56.743276 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7a961f12-43a9-407f-8099-1b45bbc924bc tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:56.744753 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7a961f12-43a9-407f-8099-1b45bbc924bc tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:56.745422 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7a961f12-43a9-407f-8099-1b45bbc924bc tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:56.836624 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7a961f12-43a9-407f-8099-1b45bbc924bc tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:56.841065 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7a961f12-43a9-407f-8099-1b45bbc924bc tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225" status: 200 len: 1272 microversion: 2.1 time: 0.116019 Oct 12 18:27:56.841993 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 168/330] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:56 2021] GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225 => generated 1272 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:56.875343 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-414a9120-71c6-4599-9a3b-79f5d7f6eaa2 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:56.876041 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-414a9120-71c6-4599-9a3b-79f5d7f6eaa2 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:56.883208 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-414a9120-71c6-4599-9a3b-79f5d7f6eaa2 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:56.888644 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-414a9120-71c6-4599-9a3b-79f5d7f6eaa2 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:56.888644 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-414a9120-71c6-4599-9a3b-79f5d7f6eaa2 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:56.888644 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-414a9120-71c6-4599-9a3b-79f5d7f6eaa2 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:57.063711 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-414a9120-71c6-4599-9a3b-79f5d7f6eaa2 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:57.074168 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-414a9120-71c6-4599-9a3b-79f5d7f6eaa2 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1522 microversion: 2.1 time: 0.200316 Oct 12 18:27:57.085689 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 163/331] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:56 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:57.563330 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-60694917-c585-4263-a9cd-1f1939df68d3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:57.564977 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-60694917-c585-4263-a9cd-1f1939df68d3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:57.577786 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-86859167-1c54-4e8d-93f3-5fbf14595192 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:57.578868 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-86859167-1c54-4e8d-93f3-5fbf14595192 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:57.582552 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-60694917-c585-4263-a9cd-1f1939df68d3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:57.585960 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-60694917-c585-4263-a9cd-1f1939df68d3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:57.593764 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-60694917-c585-4263-a9cd-1f1939df68d3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:57.593764 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-60694917-c585-4263-a9cd-1f1939df68d3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:57.597553 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-86859167-1c54-4e8d-93f3-5fbf14595192 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:57.598210 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-86859167-1c54-4e8d-93f3-5fbf14595192 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:57.603271 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-86859167-1c54-4e8d-93f3-5fbf14595192 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:57.605792 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-86859167-1c54-4e8d-93f3-5fbf14595192 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:57.706819 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-60694917-c585-4263-a9cd-1f1939df68d3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.149075 Oct 12 18:27:57.715741 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 169/332] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:57 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:27:57.731572 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-86859167-1c54-4e8d-93f3-5fbf14595192 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 0.154463 Oct 12 18:27:57.732505 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 164/333] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:57 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:27:57.861463 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-17d13ca3-2d7b-4414-902b-3be0943676c2 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:57.862332 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-17d13ca3-2d7b-4414-902b-3be0943676c2 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: d837950a-354a-44a9-9796-2049507a2225] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:57.875100 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-17d13ca3-2d7b-4414-902b-3be0943676c2 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:57.878353 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-17d13ca3-2d7b-4414-902b-3be0943676c2 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:57.879336 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-17d13ca3-2d7b-4414-902b-3be0943676c2 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:57.880383 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-17d13ca3-2d7b-4414-902b-3be0943676c2 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:58.094091 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-f8084d1e-a7ad-44d5-b415-6c1498d09d82 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:58.095173 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-f8084d1e-a7ad-44d5-b415-6c1498d09d82 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:58.111609 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f8084d1e-a7ad-44d5-b415-6c1498d09d82 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:58.112488 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f8084d1e-a7ad-44d5-b415-6c1498d09d82 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:58.113532 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f8084d1e-a7ad-44d5-b415-6c1498d09d82 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:58.114188 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f8084d1e-a7ad-44d5-b415-6c1498d09d82 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:58.240552 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-17d13ca3-2d7b-4414-902b-3be0943676c2 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:58.248872 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-17d13ca3-2d7b-4414-902b-3be0943676c2 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225" status: 200 len: 1314 microversion: 2.1 time: 0.392167 Oct 12 18:27:58.253729 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 170/334] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:57 2021] GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225 => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:58.478134 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-f8084d1e-a7ad-44d5-b415-6c1498d09d82 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:58.485979 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-f8084d1e-a7ad-44d5-b415-6c1498d09d82 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1522 microversion: 2.1 time: 0.396730 Oct 12 18:27:58.496747 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 165/335] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:58 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1522 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:27:58.724619 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-84d87af6-97fb-4bc9-a016-258d6b28b40d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:58.725534 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-84d87af6-97fb-4bc9-a016-258d6b28b40d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:58.731436 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-84d87af6-97fb-4bc9-a016-258d6b28b40d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:58.731879 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-84d87af6-97fb-4bc9-a016-258d6b28b40d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:58.732664 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-84d87af6-97fb-4bc9-a016-258d6b28b40d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:58.733087 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-84d87af6-97fb-4bc9-a016-258d6b28b40d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:58.743906 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-72d02a2f-ab43-4d71-a498-997a7a955584 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:58.745325 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-72d02a2f-ab43-4d71-a498-997a7a955584 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:58.758635 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-72d02a2f-ab43-4d71-a498-997a7a955584 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:58.759327 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-72d02a2f-ab43-4d71-a498-997a7a955584 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:58.766852 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-72d02a2f-ab43-4d71-a498-997a7a955584 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:58.766852 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-72d02a2f-ab43-4d71-a498-997a7a955584 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:58.809333 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-84d87af6-97fb-4bc9-a016-258d6b28b40d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.088418 Oct 12 18:27:58.816039 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 171/336] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:58 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:27:58.845358 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-72d02a2f-ab43-4d71-a498-997a7a955584 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 0.104905 Oct 12 18:27:58.846321 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 166/337] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:58 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:27:58.930863 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-9af4b2b4-03f3-4706-8500-584498d6bdc1 req-306b2e1b-0995-4a6e-bef1-0005036437dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d837950a-354a-44a9-9796-2049507a2225", "tag": "7433c711-5359-4625-b8ff-e5942a6a7cf3"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:58.939847 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:27:58.939847 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:27:58.968682 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-9af4b2b4-03f3-4706-8500-584498d6bdc1 req-306b2e1b-0995-4a6e-bef1-0005036437dc service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:58.970148 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-9af4b2b4-03f3-4706-8500-584498d6bdc1 req-306b2e1b-0995-4a6e-bef1-0005036437dc service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:59.000324 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-9af4b2b4-03f3-4706-8500-584498d6bdc1 req-306b2e1b-0995-4a6e-bef1-0005036437dc service nova] Creating event network-changed:7433c711-5359-4625-b8ff-e5942a6a7cf3 for instance d837950a-354a-44a9-9796-2049507a2225 on hv-cinder-81322 Oct 12 18:27:59.002960 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-9af4b2b4-03f3-4706-8500-584498d6bdc1 req-306b2e1b-0995-4a6e-bef1-0005036437dc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076540 Oct 12 18:27:59.007065 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 172/338] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:27:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:27:59.276435 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-6af5a76f-fe9b-40d7-8fe6-a4a9126dd6d6 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:59.278217 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-6af5a76f-fe9b-40d7-8fe6-a4a9126dd6d6 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: d837950a-354a-44a9-9796-2049507a2225] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:59.297309 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6af5a76f-fe9b-40d7-8fe6-a4a9126dd6d6 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:59.298498 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6af5a76f-fe9b-40d7-8fe6-a4a9126dd6d6 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:59.300240 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6af5a76f-fe9b-40d7-8fe6-a4a9126dd6d6 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:59.303116 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6af5a76f-fe9b-40d7-8fe6-a4a9126dd6d6 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:59.506086 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5dcfb9ce-adf3-4c8b-a6ff-8f309e3ea1f5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:27:59.507034 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5dcfb9ce-adf3-4c8b-a6ff-8f309e3ea1f5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:59.518935 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5dcfb9ce-adf3-4c8b-a6ff-8f309e3ea1f5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:59.518935 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5dcfb9ce-adf3-4c8b-a6ff-8f309e3ea1f5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:59.518935 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5dcfb9ce-adf3-4c8b-a6ff-8f309e3ea1f5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:59.518935 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5dcfb9ce-adf3-4c8b-a6ff-8f309e3ea1f5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:59.562239 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-6af5a76f-fe9b-40d7-8fe6-a4a9126dd6d6 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:59.574749 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-6af5a76f-fe9b-40d7-8fe6-a4a9126dd6d6 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225" status: 200 len: 1314 microversion: 2.1 time: 0.305955 Oct 12 18:27:59.575769 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 167/339] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:59 2021] GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:27:59.823018 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-015242c1-d9f0-48d0-98a1-f6537094d69c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:59.823960 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-015242c1-d9f0-48d0-98a1-f6537094d69c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:59.833439 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-015242c1-d9f0-48d0-98a1-f6537094d69c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:59.833678 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-015242c1-d9f0-48d0-98a1-f6537094d69c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:59.835206 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-015242c1-d9f0-48d0-98a1-f6537094d69c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:59.835778 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-015242c1-d9f0-48d0-98a1-f6537094d69c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:59.918015 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5dcfb9ce-adf3-4c8b-a6ff-8f309e3ea1f5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:27:59.928576 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5dcfb9ce-adf3-4c8b-a6ff-8f309e3ea1f5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1522 microversion: 2.1 time: 0.425673 Oct 12 18:27:59.930646 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 173/340] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:27:59 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1522 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:27:59.943060 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-11d98682-e8f6-4de9-a3e2-cf5a696dc0cc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:27:59.944356 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-11d98682-e8f6-4de9-a3e2-cf5a696dc0cc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:27:59.955498 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-015242c1-d9f0-48d0-98a1-f6537094d69c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.137411 Oct 12 18:27:59.956474 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 168/341] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:27:59 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:27:59.956973 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-11d98682-e8f6-4de9-a3e2-cf5a696dc0cc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:59.960223 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-11d98682-e8f6-4de9-a3e2-cf5a696dc0cc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:27:59.961154 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-11d98682-e8f6-4de9-a3e2-cf5a696dc0cc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:27:59.961564 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-11d98682-e8f6-4de9-a3e2-cf5a696dc0cc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:00.050297 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-11d98682-e8f6-4de9-a3e2-cf5a696dc0cc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 0.117440 Oct 12 18:28:00.055583 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 174/342] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:27:59 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:28:00.600367 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-a37c94f3-4e3c-40d4-afc3-7200fa2be013 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:00.601100 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-a37c94f3-4e3c-40d4-afc3-7200fa2be013 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: d837950a-354a-44a9-9796-2049507a2225] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:00.609624 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a37c94f3-4e3c-40d4-afc3-7200fa2be013 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:00.610338 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a37c94f3-4e3c-40d4-afc3-7200fa2be013 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:00.612537 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a37c94f3-4e3c-40d4-afc3-7200fa2be013 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:00.613169 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a37c94f3-4e3c-40d4-afc3-7200fa2be013 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:00.822044 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-a37c94f3-4e3c-40d4-afc3-7200fa2be013 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:00.831975 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-a37c94f3-4e3c-40d4-afc3-7200fa2be013 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225" status: 200 len: 1314 microversion: 2.1 time: 0.239373 Oct 12 18:28:00.834026 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 169/343] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:00 2021] GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:00.956891 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3aaa6f13-1d6d-448a-b187-cc4a7e7a6e81 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:00.957505 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3aaa6f13-1d6d-448a-b187-cc4a7e7a6e81 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:00.972255 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3aaa6f13-1d6d-448a-b187-cc4a7e7a6e81 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:00.975285 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3aaa6f13-1d6d-448a-b187-cc4a7e7a6e81 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:00.978768 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3aaa6f13-1d6d-448a-b187-cc4a7e7a6e81 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:00.980253 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3aaa6f13-1d6d-448a-b187-cc4a7e7a6e81 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:00.982036 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-beeb2d0e-3999-4ad2-ae97-a6b43fedf085 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:00.986166 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-beeb2d0e-3999-4ad2-ae97-a6b43fedf085 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:01.014459 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-beeb2d0e-3999-4ad2-ae97-a6b43fedf085 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:01.015403 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-beeb2d0e-3999-4ad2-ae97-a6b43fedf085 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:01.017670 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-beeb2d0e-3999-4ad2-ae97-a6b43fedf085 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:01.018678 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-beeb2d0e-3999-4ad2-ae97-a6b43fedf085 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:01.138001 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-beeb2d0e-3999-4ad2-ae97-a6b43fedf085 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.165607 Oct 12 18:28:01.139388 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 170/344] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:28:00 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:28:01.177476 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-eb9b62a9-9526-40f6-ae7f-27f0e3841187 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:01.180164 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-eb9b62a9-9526-40f6-ae7f-27f0e3841187 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:01.205887 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-eb9b62a9-9526-40f6-ae7f-27f0e3841187 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:01.207172 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-eb9b62a9-9526-40f6-ae7f-27f0e3841187 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:01.211780 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-eb9b62a9-9526-40f6-ae7f-27f0e3841187 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:01.213270 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-eb9b62a9-9526-40f6-ae7f-27f0e3841187 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:01.294297 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3aaa6f13-1d6d-448a-b187-cc4a7e7a6e81 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:01.305247 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3aaa6f13-1d6d-448a-b187-cc4a7e7a6e81 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1522 microversion: 2.1 time: 0.357104 Oct 12 18:28:01.308511 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 175/345] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:00 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:01.374065 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-eb9b62a9-9526-40f6-ae7f-27f0e3841187 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 0.233020 Oct 12 18:28:01.374838 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 171/346] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:01 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:28:01.850233 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c7e7c98c-91a7-4392-8907-f4b412f81e8a tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:01.850863 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c7e7c98c-91a7-4392-8907-f4b412f81e8a tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: d837950a-354a-44a9-9796-2049507a2225] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:01.857625 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c7e7c98c-91a7-4392-8907-f4b412f81e8a tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:01.861125 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c7e7c98c-91a7-4392-8907-f4b412f81e8a tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:01.861125 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c7e7c98c-91a7-4392-8907-f4b412f81e8a tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:01.861125 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c7e7c98c-91a7-4392-8907-f4b412f81e8a tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:02.152613 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-0af1b6db-c142-4f13-9795-20a9d22788c9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:02.154013 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-0af1b6db-c142-4f13-9795-20a9d22788c9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:02.173767 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0af1b6db-c142-4f13-9795-20a9d22788c9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:02.174217 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0af1b6db-c142-4f13-9795-20a9d22788c9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:02.175004 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0af1b6db-c142-4f13-9795-20a9d22788c9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:02.175432 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0af1b6db-c142-4f13-9795-20a9d22788c9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:02.181670 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c7e7c98c-91a7-4392-8907-f4b412f81e8a tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:02.196995 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c7e7c98c-91a7-4392-8907-f4b412f81e8a tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225" status: 200 len: 1314 microversion: 2.1 time: 0.350398 Oct 12 18:28:02.202190 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 176/347] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:01 2021] GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:02.291040 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-0af1b6db-c142-4f13-9795-20a9d22788c9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.143294 Oct 12 18:28:02.294943 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 172/348] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:28:02 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:28:02.322550 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3897bf8f-5f02-4b9b-be09-728b198d4c1f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:02.323166 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3897bf8f-5f02-4b9b-be09-728b198d4c1f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:02.341739 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3897bf8f-5f02-4b9b-be09-728b198d4c1f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:02.343697 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3897bf8f-5f02-4b9b-be09-728b198d4c1f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:02.347693 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3897bf8f-5f02-4b9b-be09-728b198d4c1f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:02.348498 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3897bf8f-5f02-4b9b-be09-728b198d4c1f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:02.390127 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-d1b316b8-1164-4749-af61-57f572c3a6ca tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:02.402196 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-d1b316b8-1164-4749-af61-57f572c3a6ca tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:02.415517 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d1b316b8-1164-4749-af61-57f572c3a6ca tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:02.415967 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d1b316b8-1164-4749-af61-57f572c3a6ca tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:02.423689 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d1b316b8-1164-4749-af61-57f572c3a6ca tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:02.424175 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d1b316b8-1164-4749-af61-57f572c3a6ca tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:02.499821 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-d1b316b8-1164-4749-af61-57f572c3a6ca tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 0.113784 Oct 12 18:28:02.499821 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 173/349] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:02 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:28:02.700366 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3897bf8f-5f02-4b9b-be09-728b198d4c1f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:02.710082 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3897bf8f-5f02-4b9b-be09-728b198d4c1f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1522 microversion: 2.1 time: 0.391102 Oct 12 18:28:02.713136 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 177/350] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:02 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1522 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:03.228132 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-89b665a3-e32d-4cd4-9d4f-e16f802c85e3 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:03.231188 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-89b665a3-e32d-4cd4-9d4f-e16f802c85e3 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: d837950a-354a-44a9-9796-2049507a2225] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:03.246005 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-89b665a3-e32d-4cd4-9d4f-e16f802c85e3 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:03.246458 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-89b665a3-e32d-4cd4-9d4f-e16f802c85e3 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:03.247253 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-89b665a3-e32d-4cd4-9d4f-e16f802c85e3 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:03.250717 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-89b665a3-e32d-4cd4-9d4f-e16f802c85e3 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:03.306214 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0a0fd908-50da-4ab3-9939-37f01cf901a8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:03.307846 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0a0fd908-50da-4ab3-9939-37f01cf901a8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:03.320097 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0a0fd908-50da-4ab3-9939-37f01cf901a8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:03.321497 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0a0fd908-50da-4ab3-9939-37f01cf901a8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:03.322790 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0a0fd908-50da-4ab3-9939-37f01cf901a8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:03.323600 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0a0fd908-50da-4ab3-9939-37f01cf901a8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:03.410863 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0a0fd908-50da-4ab3-9939-37f01cf901a8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.110851 Oct 12 18:28:03.415222 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 178/351] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:28:03 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:28:03.517401 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2aedf086-8d02-45fc-b291-190fec9eaf1f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:03.519090 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2aedf086-8d02-45fc-b291-190fec9eaf1f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:03.524509 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-89b665a3-e32d-4cd4-9d4f-e16f802c85e3 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:03.530143 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2aedf086-8d02-45fc-b291-190fec9eaf1f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:03.530912 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2aedf086-8d02-45fc-b291-190fec9eaf1f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:03.532331 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2aedf086-8d02-45fc-b291-190fec9eaf1f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:03.538236 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-89b665a3-e32d-4cd4-9d4f-e16f802c85e3 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225" status: 200 len: 1314 microversion: 2.1 time: 0.318521 Oct 12 18:28:03.538899 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 174/352] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:03 2021] GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:03.540258 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2aedf086-8d02-45fc-b291-190fec9eaf1f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:03.634736 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2aedf086-8d02-45fc-b291-190fec9eaf1f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 0.124527 Oct 12 18:28:03.636321 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 179/353] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:03 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:28:03.737925 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c36b9d25-7105-4ac3-808a-d82f8de2923a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:03.738772 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c36b9d25-7105-4ac3-808a-d82f8de2923a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:03.748547 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c36b9d25-7105-4ac3-808a-d82f8de2923a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:03.749287 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c36b9d25-7105-4ac3-808a-d82f8de2923a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:03.750294 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c36b9d25-7105-4ac3-808a-d82f8de2923a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:03.750975 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c36b9d25-7105-4ac3-808a-d82f8de2923a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:03.939379 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c36b9d25-7105-4ac3-808a-d82f8de2923a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:03.948585 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c36b9d25-7105-4ac3-808a-d82f8de2923a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1522 microversion: 2.1 time: 0.217052 Oct 12 18:28:03.949637 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 175/354] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:03 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:04.424217 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-41486d63-111c-491b-855f-8095ad4f07ea tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:04.425507 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-41486d63-111c-491b-855f-8095ad4f07ea tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:04.433038 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-41486d63-111c-491b-855f-8095ad4f07ea tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:04.433554 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-41486d63-111c-491b-855f-8095ad4f07ea tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:04.434622 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-41486d63-111c-491b-855f-8095ad4f07ea tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:04.435129 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-41486d63-111c-491b-855f-8095ad4f07ea tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:04.543140 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-41486d63-111c-491b-855f-8095ad4f07ea tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.121190 Oct 12 18:28:04.545453 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 180/355] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:28:04 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:28:04.554951 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-f69cb9cf-cd5b-4b79-8d9d-74b79a10deca tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:04.555563 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-f69cb9cf-cd5b-4b79-8d9d-74b79a10deca tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: d837950a-354a-44a9-9796-2049507a2225] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:04.563347 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f69cb9cf-cd5b-4b79-8d9d-74b79a10deca tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:04.564796 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f69cb9cf-cd5b-4b79-8d9d-74b79a10deca tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:04.565756 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f69cb9cf-cd5b-4b79-8d9d-74b79a10deca tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:04.566371 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f69cb9cf-cd5b-4b79-8d9d-74b79a10deca tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:04.648662 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5c11a766-6f0a-4b2c-9243-a7a80516618d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:04.649675 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5c11a766-6f0a-4b2c-9243-a7a80516618d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:04.668237 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5c11a766-6f0a-4b2c-9243-a7a80516618d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:04.668711 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5c11a766-6f0a-4b2c-9243-a7a80516618d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:04.669505 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5c11a766-6f0a-4b2c-9243-a7a80516618d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:04.669932 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5c11a766-6f0a-4b2c-9243-a7a80516618d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:04.768996 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5c11a766-6f0a-4b2c-9243-a7a80516618d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 0.124249 Oct 12 18:28:04.770310 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 181/356] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:04 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:28:04.793914 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-f69cb9cf-cd5b-4b79-8d9d-74b79a10deca tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:04.802669 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-f69cb9cf-cd5b-4b79-8d9d-74b79a10deca tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225" status: 200 len: 1314 microversion: 2.1 time: 0.251251 Oct 12 18:28:04.803807 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 176/357] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:04 2021] GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:04.966477 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-005ae196-f8f7-44bb-8996-12bd3a574b7f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:04.967601 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-005ae196-f8f7-44bb-8996-12bd3a574b7f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:04.983021 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-005ae196-f8f7-44bb-8996-12bd3a574b7f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:04.983664 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-005ae196-f8f7-44bb-8996-12bd3a574b7f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:04.984642 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-005ae196-f8f7-44bb-8996-12bd3a574b7f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:04.985204 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-005ae196-f8f7-44bb-8996-12bd3a574b7f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:05.303283 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-005ae196-f8f7-44bb-8996-12bd3a574b7f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:05.312006 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-005ae196-f8f7-44bb-8996-12bd3a574b7f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1522 microversion: 2.1 time: 0.349698 Oct 12 18:28:05.312627 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 182/358] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:04 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:05.560832 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-099f1801-244d-4778-88a3-0432409b0858 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:05.562644 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-099f1801-244d-4778-88a3-0432409b0858 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:05.570345 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-099f1801-244d-4778-88a3-0432409b0858 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:05.571268 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-099f1801-244d-4778-88a3-0432409b0858 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:05.572306 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-099f1801-244d-4778-88a3-0432409b0858 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:05.573062 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-099f1801-244d-4778-88a3-0432409b0858 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:05.648746 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-099f1801-244d-4778-88a3-0432409b0858 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.092740 Oct 12 18:28:05.661868 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 177/359] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:28:05 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:28:05.784453 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-01d8c7b1-325b-4aca-a581-cbb452f1c2e3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:05.785757 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-01d8c7b1-325b-4aca-a581-cbb452f1c2e3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:05.793425 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-01d8c7b1-325b-4aca-a581-cbb452f1c2e3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:05.794245 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-01d8c7b1-325b-4aca-a581-cbb452f1c2e3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:05.795208 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-01d8c7b1-325b-4aca-a581-cbb452f1c2e3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:05.796384 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-01d8c7b1-325b-4aca-a581-cbb452f1c2e3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:05.822613 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-7c1f3b6f-b8ac-49aa-89d3-e13021ce181f tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:05.823817 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-7c1f3b6f-b8ac-49aa-89d3-e13021ce181f tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: d837950a-354a-44a9-9796-2049507a2225] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:05.839443 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7c1f3b6f-b8ac-49aa-89d3-e13021ce181f tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:05.840018 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7c1f3b6f-b8ac-49aa-89d3-e13021ce181f tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:05.841038 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7c1f3b6f-b8ac-49aa-89d3-e13021ce181f tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:05.841568 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7c1f3b6f-b8ac-49aa-89d3-e13021ce181f tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:05.933878 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-01d8c7b1-325b-4aca-a581-cbb452f1c2e3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 0.154292 Oct 12 18:28:05.935342 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 183/360] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:05 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:28:06.035960 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-7c1f3b6f-b8ac-49aa-89d3-e13021ce181f tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:06.045083 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-7c1f3b6f-b8ac-49aa-89d3-e13021ce181f tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225" status: 200 len: 1314 microversion: 2.1 time: 0.227843 Oct 12 18:28:06.056759 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 178/361] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:05 2021] GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:06.331282 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e2418f01-b73e-45a7-a6f0-b4cb312218d7 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:06.332443 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e2418f01-b73e-45a7-a6f0-b4cb312218d7 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:06.343399 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e2418f01-b73e-45a7-a6f0-b4cb312218d7 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:06.345899 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e2418f01-b73e-45a7-a6f0-b4cb312218d7 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:06.347431 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e2418f01-b73e-45a7-a6f0-b4cb312218d7 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:06.348203 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e2418f01-b73e-45a7-a6f0-b4cb312218d7 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:06.527611 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e2418f01-b73e-45a7-a6f0-b4cb312218d7 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:06.536065 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e2418f01-b73e-45a7-a6f0-b4cb312218d7 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1522 microversion: 2.1 time: 0.209788 Oct 12 18:28:06.545786 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 184/362] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:06 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:06.664983 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-118ff0e4-3d5c-4a71-8fcc-a6b0e9c0297c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:06.666915 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-118ff0e4-3d5c-4a71-8fcc-a6b0e9c0297c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:06.676321 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-118ff0e4-3d5c-4a71-8fcc-a6b0e9c0297c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:06.677236 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-118ff0e4-3d5c-4a71-8fcc-a6b0e9c0297c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:06.679643 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-118ff0e4-3d5c-4a71-8fcc-a6b0e9c0297c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:06.680725 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-118ff0e4-3d5c-4a71-8fcc-a6b0e9c0297c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:06.754575 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-118ff0e4-3d5c-4a71-8fcc-a6b0e9c0297c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.096526 Oct 12 18:28:06.758711 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 179/363] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:28:06 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:28:06.946089 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e0b1633e-9e5e-42ae-89d8-2e06439bb062 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:06.947802 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e0b1633e-9e5e-42ae-89d8-2e06439bb062 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:06.956148 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e0b1633e-9e5e-42ae-89d8-2e06439bb062 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:06.957150 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e0b1633e-9e5e-42ae-89d8-2e06439bb062 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:06.958230 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e0b1633e-9e5e-42ae-89d8-2e06439bb062 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:06.958886 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e0b1633e-9e5e-42ae-89d8-2e06439bb062 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:07.042875 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e0b1633e-9e5e-42ae-89d8-2e06439bb062 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 0.100522 Oct 12 18:28:07.043775 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 185/364] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:06 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:28:07.073449 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-bba323c7-8fdc-4c4d-80b6-238e20c3be06 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:07.079996 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-bba323c7-8fdc-4c4d-80b6-238e20c3be06 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: d837950a-354a-44a9-9796-2049507a2225] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:07.095873 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bba323c7-8fdc-4c4d-80b6-238e20c3be06 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:07.097524 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bba323c7-8fdc-4c4d-80b6-238e20c3be06 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:07.099052 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bba323c7-8fdc-4c4d-80b6-238e20c3be06 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:07.100452 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bba323c7-8fdc-4c4d-80b6-238e20c3be06 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:07.402765 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-bba323c7-8fdc-4c4d-80b6-238e20c3be06 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:07.413878 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-bba323c7-8fdc-4c4d-80b6-238e20c3be06 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225" status: 200 len: 1314 microversion: 2.1 time: 0.354943 Oct 12 18:28:07.414879 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 180/365] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:07 2021] GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:07.554476 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-dedbbcb7-b04d-42a7-be7c-f5655511d5e3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:07.555173 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-dedbbcb7-b04d-42a7-be7c-f5655511d5e3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:07.570570 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dedbbcb7-b04d-42a7-be7c-f5655511d5e3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:07.572989 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dedbbcb7-b04d-42a7-be7c-f5655511d5e3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:07.575643 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dedbbcb7-b04d-42a7-be7c-f5655511d5e3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:07.577592 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dedbbcb7-b04d-42a7-be7c-f5655511d5e3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:07.776470 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-3f2d17c0-848f-44f3-8677-3df89b0b483a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:07.777521 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-3f2d17c0-848f-44f3-8677-3df89b0b483a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:07.817586 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3f2d17c0-848f-44f3-8677-3df89b0b483a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:07.820944 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3f2d17c0-848f-44f3-8677-3df89b0b483a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:07.825776 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3f2d17c0-848f-44f3-8677-3df89b0b483a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:07.829398 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3f2d17c0-848f-44f3-8677-3df89b0b483a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:07.939964 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-dedbbcb7-b04d-42a7-be7c-f5655511d5e3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:07.951546 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-dedbbcb7-b04d-42a7-be7c-f5655511d5e3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1522 microversion: 2.1 time: 0.399032 Oct 12 18:28:07.952539 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 186/366] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:07 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1522 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:28:07.976584 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-3f2d17c0-848f-44f3-8677-3df89b0b483a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.205230 Oct 12 18:28:07.976584 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 181/367] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:28:07 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:28:08.069815 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-364ebe15-cd4d-4cd1-bb95-b3dda97c1b7f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:08.080906 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-364ebe15-cd4d-4cd1-bb95-b3dda97c1b7f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:08.113825 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-364ebe15-cd4d-4cd1-bb95-b3dda97c1b7f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:08.114354 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-364ebe15-cd4d-4cd1-bb95-b3dda97c1b7f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:08.115161 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-364ebe15-cd4d-4cd1-bb95-b3dda97c1b7f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:08.115597 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-364ebe15-cd4d-4cd1-bb95-b3dda97c1b7f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:08.199404 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-364ebe15-cd4d-4cd1-bb95-b3dda97c1b7f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 0.147098 Oct 12 18:28:08.201716 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 187/368] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:08 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:28:08.432099 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-f70e4b56-13ce-4e21-8f52-596e0cf26a0a tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:08.433114 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-f70e4b56-13ce-4e21-8f52-596e0cf26a0a tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: d837950a-354a-44a9-9796-2049507a2225] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:08.446266 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f70e4b56-13ce-4e21-8f52-596e0cf26a0a tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:08.450439 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f70e4b56-13ce-4e21-8f52-596e0cf26a0a tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:08.452968 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f70e4b56-13ce-4e21-8f52-596e0cf26a0a tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:08.453439 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f70e4b56-13ce-4e21-8f52-596e0cf26a0a tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:08.970217 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-64114fa7-041f-4e05-abe0-daee14e646b1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:08.971068 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-64114fa7-041f-4e05-abe0-daee14e646b1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:08.981167 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-64114fa7-041f-4e05-abe0-daee14e646b1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:08.981622 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-64114fa7-041f-4e05-abe0-daee14e646b1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:08.982432 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-64114fa7-041f-4e05-abe0-daee14e646b1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:08.982871 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-64114fa7-041f-4e05-abe0-daee14e646b1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:09.350936 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-f70e4b56-13ce-4e21-8f52-596e0cf26a0a tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:09.361183 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-f70e4b56-13ce-4e21-8f52-596e0cf26a0a tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225" status: 200 len: 1314 microversion: 2.1 time: 0.933514 Oct 12 18:28:09.366487 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 182/369] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:08 2021] GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225 => generated 1314 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:09.380808 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-6272eb3d-6f8f-4bc6-9f4d-d90060c59cb0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:09.382128 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-6272eb3d-6f8f-4bc6-9f4d-d90060c59cb0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:09.395471 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6272eb3d-6f8f-4bc6-9f4d-d90060c59cb0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:09.397758 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6272eb3d-6f8f-4bc6-9f4d-d90060c59cb0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:09.403028 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6272eb3d-6f8f-4bc6-9f4d-d90060c59cb0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:09.403028 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6272eb3d-6f8f-4bc6-9f4d-d90060c59cb0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:09.521404 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-6272eb3d-6f8f-4bc6-9f4d-d90060c59cb0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.152091 Oct 12 18:28:09.523620 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 183/370] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:28:09 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:28:09.537640 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-cccfcc67-b8e3-4aa2-b342-622e11f75ac4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:09.545768 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-cccfcc67-b8e3-4aa2-b342-622e11f75ac4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:09.556611 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cccfcc67-b8e3-4aa2-b342-622e11f75ac4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:09.557388 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cccfcc67-b8e3-4aa2-b342-622e11f75ac4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:09.558864 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cccfcc67-b8e3-4aa2-b342-622e11f75ac4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:09.559483 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cccfcc67-b8e3-4aa2-b342-622e11f75ac4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:09.663201 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-64114fa7-041f-4e05-abe0-daee14e646b1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:09.665953 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-cccfcc67-b8e3-4aa2-b342-622e11f75ac4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 0.140251 Oct 12 18:28:09.666612 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 184/371] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:09 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:28:09.676793 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-64114fa7-041f-4e05-abe0-daee14e646b1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1522 microversion: 2.1 time: 0.710257 Oct 12 18:28:09.677965 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 188/372] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:08 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1522 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:28:10.380272 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-b07bdf2e-7d20-4dfa-966f-2c7451981a71 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:10.381770 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-b07bdf2e-7d20-4dfa-966f-2c7451981a71 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: d837950a-354a-44a9-9796-2049507a2225] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:10.394649 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b07bdf2e-7d20-4dfa-966f-2c7451981a71 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:10.396714 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b07bdf2e-7d20-4dfa-966f-2c7451981a71 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:10.402707 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b07bdf2e-7d20-4dfa-966f-2c7451981a71 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:10.403566 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b07bdf2e-7d20-4dfa-966f-2c7451981a71 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:10.683021 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-b07bdf2e-7d20-4dfa-966f-2c7451981a71 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:10.701592 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-b07bdf2e-7d20-4dfa-966f-2c7451981a71 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225" status: 200 len: 1314 microversion: 2.1 time: 0.327200 Oct 12 18:28:10.704981 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 185/373] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:10 2021] GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:10.723918 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-19e2575a-116e-4327-b579-19941d917826 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:10.727549 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-19e2575a-116e-4327-b579-19941d917826 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:10.734097 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-19e2575a-116e-4327-b579-19941d917826 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:10.734543 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-19e2575a-116e-4327-b579-19941d917826 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:10.735412 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-19e2575a-116e-4327-b579-19941d917826 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:10.735848 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-19e2575a-116e-4327-b579-19941d917826 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:10.768479 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d0dab8ed-74d2-49c7-81c2-f071b8434d36 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Action: 'create', calling method: .version_select at 0x7fe297f8cdc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-800000789"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:10.811579 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-d0dab8ed-74d2-49c7-81c2-f071b8434d36 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Getting quotas for project d1b808c36ccd4256858530aedc0a6f64. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:28:10.826735 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-d0dab8ed-74d2-49c7-81c2-f071b8434d36 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Getting quotas for user 9a37985dd5034ceeabfa47797efba5a1 and project d1b808c36ccd4256858530aedc0a6f64. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:28:10.830151 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-19e2575a-116e-4327-b579-19941d917826 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.123005 Oct 12 18:28:10.835467 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 186/374] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:28:10 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:28:10.845906 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-b233261d-8f40-4ad7-9d9c-73ca4e772d0c req-bc044281-87b6-45c1-b58c-40fb80d3d838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d837950a-354a-44a9-9796-2049507a2225", "name": "network-vif-plugged", "status": "completed", "tag": "7433c711-5359-4625-b8ff-e5942a6a7cf3"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:10.854597 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:28:10.854597 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:28:10.865888 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-b233261d-8f40-4ad7-9d9c-73ca4e772d0c req-bc044281-87b6-45c1-b58c-40fb80d3d838 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:10.867477 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-b233261d-8f40-4ad7-9d9c-73ca4e772d0c req-bc044281-87b6-45c1-b58c-40fb80d3d838 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:10.899749 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-b233261d-8f40-4ad7-9d9c-73ca4e772d0c req-bc044281-87b6-45c1-b58c-40fb80d3d838 service nova] Creating event network-vif-plugged:7433c711-5359-4625-b8ff-e5942a6a7cf3 for instance d837950a-354a-44a9-9796-2049507a2225 on hv-cinder-81322 Oct 12 18:28:10.906863 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-b233261d-8f40-4ad7-9d9c-73ca4e772d0c req-bc044281-87b6-45c1-b58c-40fb80d3d838 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069180 Oct 12 18:28:10.908675 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 187/375] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:28:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:28:10.915638 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c808112e-0689-47ee-98fb-ffc269352ad5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:10.916944 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c808112e-0689-47ee-98fb-ffc269352ad5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:10.928992 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c808112e-0689-47ee-98fb-ffc269352ad5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:10.928992 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c808112e-0689-47ee-98fb-ffc269352ad5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:10.928992 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c808112e-0689-47ee-98fb-ffc269352ad5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:10.929536 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c808112e-0689-47ee-98fb-ffc269352ad5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:11.045131 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c808112e-0689-47ee-98fb-ffc269352ad5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 0.134615 Oct 12 18:28:11.050655 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 188/376] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:10 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:28:11.059180 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-a4914ed9-27c1-4712-aee3-3aae437a2e02 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:11.061194 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-a4914ed9-27c1-4712-aee3-3aae437a2e02 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:11.079207 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a4914ed9-27c1-4712-aee3-3aae437a2e02 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:11.081197 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a4914ed9-27c1-4712-aee3-3aae437a2e02 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:11.085012 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a4914ed9-27c1-4712-aee3-3aae437a2e02 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:11.086259 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a4914ed9-27c1-4712-aee3-3aae437a2e02 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:11.350055 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-d0dab8ed-74d2-49c7-81c2-f071b8434d36 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Getting quotas for project d1b808c36ccd4256858530aedc0a6f64. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:28:11.355595 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-d0dab8ed-74d2-49c7-81c2-f071b8434d36 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Getting quotas for user 9a37985dd5034ceeabfa47797efba5a1 and project d1b808c36ccd4256858530aedc0a6f64. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:28:11.369252 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d0dab8ed-74d2-49c7-81c2-f071b8434d36 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.908830 Oct 12 18:28:11.370046 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 189/377] 10.222.0.18 () {60 vars in 1157 bytes} [Tue Oct 12 18:28:10 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:11.371867 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-a4914ed9-27c1-4712-aee3-3aae437a2e02 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:11.380903 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-a4914ed9-27c1-4712-aee3-3aae437a2e02 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1502 microversion: 2.1 time: 0.328057 Oct 12 18:28:11.382571 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 189/378] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:11 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1502 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:11.397988 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-37cbd265-4744-4664-88b1-1550e4e84e87 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:11.398791 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-37cbd265-4744-4664-88b1-1550e4e84e87 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:11.405465 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-37cbd265-4744-4664-88b1-1550e4e84e87 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:11.406288 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-37cbd265-4744-4664-88b1-1550e4e84e87 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:11.406689 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-37cbd265-4744-4664-88b1-1550e4e84e87 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:11.407836 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-37cbd265-4744-4664-88b1-1550e4e84e87 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:11.634953 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-37cbd265-4744-4664-88b1-1550e4e84e87 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:11.641365 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-37cbd265-4744-4664-88b1-1550e4e84e87 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1517 microversion: 2.1 time: 0.247006 Oct 12 18:28:11.642064 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 190/379] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:11 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1517 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:11.720887 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-be6109a2-bbba-47a6-8552-306461f6f784 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:11.721496 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-be6109a2-bbba-47a6-8552-306461f6f784 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: d837950a-354a-44a9-9796-2049507a2225] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:11.740392 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-be6109a2-bbba-47a6-8552-306461f6f784 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:11.741140 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-be6109a2-bbba-47a6-8552-306461f6f784 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:11.743109 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-be6109a2-bbba-47a6-8552-306461f6f784 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:11.743986 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-be6109a2-bbba-47a6-8552-306461f6f784 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:11.845164 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b5603ba7-17c8-4cc4-8f24-6bbf9fe0cca6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:11.847521 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b5603ba7-17c8-4cc4-8f24-6bbf9fe0cca6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:11.856968 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b5603ba7-17c8-4cc4-8f24-6bbf9fe0cca6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:11.857816 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b5603ba7-17c8-4cc4-8f24-6bbf9fe0cca6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:11.859534 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b5603ba7-17c8-4cc4-8f24-6bbf9fe0cca6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:11.860340 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b5603ba7-17c8-4cc4-8f24-6bbf9fe0cca6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:11.937005 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b5603ba7-17c8-4cc4-8f24-6bbf9fe0cca6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.097968 Oct 12 18:28:11.937651 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 191/380] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:28:11 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:28:11.968627 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-be6109a2-bbba-47a6-8552-306461f6f784 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:11.976882 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-be6109a2-bbba-47a6-8552-306461f6f784 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225" status: 200 len: 1314 microversion: 2.1 time: 0.260181 Oct 12 18:28:11.989624 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 190/381] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:11 2021] GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:12.058336 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-7d45f804-96fb-4a6e-98c5-7e587fa99367 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:12.059456 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-7d45f804-96fb-4a6e-98c5-7e587fa99367 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:12.070138 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7d45f804-96fb-4a6e-98c5-7e587fa99367 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:12.070138 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7d45f804-96fb-4a6e-98c5-7e587fa99367 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:12.070138 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7d45f804-96fb-4a6e-98c5-7e587fa99367 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:12.070138 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7d45f804-96fb-4a6e-98c5-7e587fa99367 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:12.214226 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2fd009ce-27b7-42eb-b6e4-5086e43b2847 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Action: 'create', calling method: .version_select at 0x7fe2a4061670>, body: {"keypair": {"name": "tempest-TestShelveInstance-1852199283"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:12.225690 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-7d45f804-96fb-4a6e-98c5-7e587fa99367 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 0.171367 Oct 12 18:28:12.233885 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 191/382] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:12 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:28:12.239500 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-2fd009ce-27b7-42eb-b6e4-5086e43b2847 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Getting quotas for project 38a1ca7b8f55456eb3c6946099885e5e. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:28:12.239500 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-2fd009ce-27b7-42eb-b6e4-5086e43b2847 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Getting quotas for user d6959ea6a5c642258bc40a8fe0c2b3ce and project 38a1ca7b8f55456eb3c6946099885e5e. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:28:12.524915 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-2fd009ce-27b7-42eb-b6e4-5086e43b2847 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Getting quotas for project 38a1ca7b8f55456eb3c6946099885e5e. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:28:12.536020 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-2fd009ce-27b7-42eb-b6e4-5086e43b2847 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Getting quotas for user d6959ea6a5c642258bc40a8fe0c2b3ce and project 38a1ca7b8f55456eb3c6946099885e5e. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:28:12.565502 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2fd009ce-27b7-42eb-b6e4-5086e43b2847 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.576535 Oct 12 18:28:12.571548 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 192/383] 10.222.0.18 () {60 vars in 1157 bytes} [Tue Oct 12 18:28:11 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:12.953237 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-1303fdd9-fbb3-4e7b-991f-8d5bee515548 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:12.954952 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-1303fdd9-fbb3-4e7b-991f-8d5bee515548 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:12.962640 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1303fdd9-fbb3-4e7b-991f-8d5bee515548 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:12.963092 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1303fdd9-fbb3-4e7b-991f-8d5bee515548 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:12.963938 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1303fdd9-fbb3-4e7b-991f-8d5bee515548 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:12.964380 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1303fdd9-fbb3-4e7b-991f-8d5bee515548 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:12.994603 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3e599705-136e-4a62-868b-cb3b019e57cb tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:12.995409 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3e599705-136e-4a62-868b-cb3b019e57cb tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: d837950a-354a-44a9-9796-2049507a2225] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:13.005897 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3e599705-136e-4a62-868b-cb3b019e57cb tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:13.006361 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3e599705-136e-4a62-868b-cb3b019e57cb tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:13.007192 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3e599705-136e-4a62-868b-cb3b019e57cb tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:13.007633 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3e599705-136e-4a62-868b-cb3b019e57cb tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:13.046807 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-1303fdd9-fbb3-4e7b-991f-8d5bee515548 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.100883 Oct 12 18:28:13.057554 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 192/384] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:28:12 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:28:13.239516 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3e599705-136e-4a62-868b-cb3b019e57cb tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:13.248995 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-21fe419e-0ea8-4836-ad2e-04a756426410 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:13.249968 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-21fe419e-0ea8-4836-ad2e-04a756426410 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:13.253954 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3e599705-136e-4a62-868b-cb3b019e57cb tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225" status: 200 len: 1314 microversion: 2.1 time: 0.262756 Oct 12 18:28:13.255614 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 193/385] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:12 2021] GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:13.267158 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-21fe419e-0ea8-4836-ad2e-04a756426410 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:13.267602 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-21fe419e-0ea8-4836-ad2e-04a756426410 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:13.268675 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-21fe419e-0ea8-4836-ad2e-04a756426410 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:13.269261 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-21fe419e-0ea8-4836-ad2e-04a756426410 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:13.383230 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-21fe419e-0ea8-4836-ad2e-04a756426410 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 0.138139 Oct 12 18:28:13.384828 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 193/386] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:13 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:28:13.517756 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f366fdbe-1db7-4f55-941e-0ddbdfb84289 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:13.519453 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f366fdbe-1db7-4f55-941e-0ddbdfb84289 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:13.527417 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f366fdbe-1db7-4f55-941e-0ddbdfb84289 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:13.528207 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f366fdbe-1db7-4f55-941e-0ddbdfb84289 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:13.529301 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f366fdbe-1db7-4f55-941e-0ddbdfb84289 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:13.529952 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f366fdbe-1db7-4f55-941e-0ddbdfb84289 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:13.558855 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-f366fdbe-1db7-4f55-941e-0ddbdfb84289 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lazy-loading 'flavor' on Instance uuid 4ade368f-e898-4346-83a8-3d3eb86c8192 {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:28:13.930090 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f366fdbe-1db7-4f55-941e-0ddbdfb84289 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "POST /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192/action" status: 200 len: 32 microversion: 2.1 time: 0.423868 Oct 12 18:28:13.931080 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 194/387] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:28:13 2021] POST /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192/action => generated 32 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 18:28:13.944118 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-53e94951-74ee-4318-889f-92ce765969b5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:13.944847 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-53e94951-74ee-4318-889f-92ce765969b5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:13.951387 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-53e94951-74ee-4318-889f-92ce765969b5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:13.951831 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-53e94951-74ee-4318-889f-92ce765969b5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:13.952660 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-53e94951-74ee-4318-889f-92ce765969b5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:13.953083 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-53e94951-74ee-4318-889f-92ce765969b5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:14.067437 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1a8fc3ce-f323-47d3-b134-3ef82d8c6592 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:14.069642 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1a8fc3ce-f323-47d3-b134-3ef82d8c6592 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:14.083281 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1a8fc3ce-f323-47d3-b134-3ef82d8c6592 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:14.083621 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1a8fc3ce-f323-47d3-b134-3ef82d8c6592 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:14.084520 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1a8fc3ce-f323-47d3-b134-3ef82d8c6592 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:14.088519 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1a8fc3ce-f323-47d3-b134-3ef82d8c6592 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:14.156261 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-53e94951-74ee-4318-889f-92ce765969b5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:14.157241 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1a8fc3ce-f323-47d3-b134-3ef82d8c6592 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 28659 microversion: 2.1 time: 0.094784 Oct 12 18:28:14.159067 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 195/388] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:28:14 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 28659 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:28:14.170393 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-53e94951-74ee-4318-889f-92ce765969b5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.229074 Oct 12 18:28:14.171112 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 194/389] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:13 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:14.271669 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9ae18485-3070-455d-9710-a0936176b08f tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:14.273183 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9ae18485-3070-455d-9710-a0936176b08f tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: d837950a-354a-44a9-9796-2049507a2225] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:14.282689 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9ae18485-3070-455d-9710-a0936176b08f tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:14.283373 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9ae18485-3070-455d-9710-a0936176b08f tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:14.284298 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9ae18485-3070-455d-9710-a0936176b08f tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:14.284876 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9ae18485-3070-455d-9710-a0936176b08f tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:14.397693 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c935b993-bd66-4458-8028-cc2d9ae6cd61 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:14.399075 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c935b993-bd66-4458-8028-cc2d9ae6cd61 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:14.406296 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c935b993-bd66-4458-8028-cc2d9ae6cd61 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:14.407231 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c935b993-bd66-4458-8028-cc2d9ae6cd61 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:14.408240 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c935b993-bd66-4458-8028-cc2d9ae6cd61 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:14.409145 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c935b993-bd66-4458-8028-cc2d9ae6cd61 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:14.510688 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c935b993-bd66-4458-8028-cc2d9ae6cd61 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 0.119064 Oct 12 18:28:14.511540 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 195/390] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:14 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:28:14.525687 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9ae18485-3070-455d-9710-a0936176b08f tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:14.544204 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9ae18485-3070-455d-9710-a0936176b08f tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225" status: 200 len: 1497 microversion: 2.1 time: 0.276127 Oct 12 18:28:14.545130 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 196/391] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:14 2021] GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225 => generated 1497 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:28:15.173429 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-20e1d6bf-f758-47ec-8e82-b7c39c09244b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:15.173429 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-20e1d6bf-f758-47ec-8e82-b7c39c09244b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:15.182146 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-20e1d6bf-f758-47ec-8e82-b7c39c09244b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:15.182933 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-20e1d6bf-f758-47ec-8e82-b7c39c09244b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:15.184160 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-20e1d6bf-f758-47ec-8e82-b7c39c09244b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:15.184995 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-20e1d6bf-f758-47ec-8e82-b7c39c09244b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:15.189236 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-34c77553-f6ae-4f4a-a17e-ed0e111bbb73 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:15.190113 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-34c77553-f6ae-4f4a-a17e-ed0e111bbb73 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:15.206631 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-34c77553-f6ae-4f4a-a17e-ed0e111bbb73 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:15.206631 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-34c77553-f6ae-4f4a-a17e-ed0e111bbb73 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:15.206631 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-34c77553-f6ae-4f4a-a17e-ed0e111bbb73 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:15.206631 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-34c77553-f6ae-4f4a-a17e-ed0e111bbb73 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:15.291121 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-20e1d6bf-f758-47ec-8e82-b7c39c09244b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 29158 microversion: 2.1 time: 0.124268 Oct 12 18:28:15.292345 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 196/392] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:28:15 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 29158 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:28:15.414703 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-34c77553-f6ae-4f4a-a17e-ed0e111bbb73 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:15.465300 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-34c77553-f6ae-4f4a-a17e-ed0e111bbb73 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.265508 Oct 12 18:28:15.465300 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 197/393] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:15 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:28:15.524694 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-41a8fe97-f435-4612-ada7-fced7fdc763e tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:15.524953 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-ec2bf8c5-a304-40dc-853e-f99de2b2a09e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:15.525477 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-41a8fe97-f435-4612-ada7-fced7fdc763e tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: d837950a-354a-44a9-9796-2049507a2225] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:15.525955 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-ec2bf8c5-a304-40dc-853e-f99de2b2a09e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:15.533209 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-41a8fe97-f435-4612-ada7-fced7fdc763e tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:15.533878 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-41a8fe97-f435-4612-ada7-fced7fdc763e tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:15.533990 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ec2bf8c5-a304-40dc-853e-f99de2b2a09e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:15.534291 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ec2bf8c5-a304-40dc-853e-f99de2b2a09e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:15.534826 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-41a8fe97-f435-4612-ada7-fced7fdc763e tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:15.535281 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ec2bf8c5-a304-40dc-853e-f99de2b2a09e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:15.535391 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-41a8fe97-f435-4612-ada7-fced7fdc763e tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:15.535718 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ec2bf8c5-a304-40dc-853e-f99de2b2a09e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:15.563971 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-41a8fe97-f435-4612-ada7-fced7fdc763e tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: d837950a-354a-44a9-9796-2049507a2225] Going to try to terminate instance {{(pid=109168) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 18:28:15.623603 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-ec2bf8c5-a304-40dc-853e-f99de2b2a09e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 0.101833 Oct 12 18:28:15.624432 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 197/394] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:15 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:28:15.922479 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-41a8fe97-f435-4612-ada7-fced7fdc763e tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225" status: 204 len: 0 microversion: 2.1 time: 0.401194 Oct 12 18:28:15.924437 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 198/395] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Oct 12 18:28:15 2021] DELETE /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 18:28:15.932887 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-41e26749-6137-4b61-85e7-fca212f55f52 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:15.933883 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-41e26749-6137-4b61-85e7-fca212f55f52 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: d837950a-354a-44a9-9796-2049507a2225] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:15.943329 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-41e26749-6137-4b61-85e7-fca212f55f52 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:15.943693 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-41e26749-6137-4b61-85e7-fca212f55f52 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:15.944519 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-41e26749-6137-4b61-85e7-fca212f55f52 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:15.945136 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-41e26749-6137-4b61-85e7-fca212f55f52 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:16.111793 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-41e26749-6137-4b61-85e7-fca212f55f52 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:16.123149 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-41e26749-6137-4b61-85e7-fca212f55f52 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225" status: 200 len: 1503 microversion: 2.1 time: 0.193798 Oct 12 18:28:16.124233 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 198/396] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:15 2021] GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225 => generated 1503 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:28:16.303600 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-85eed84c-e0e2-4ba3-9de8-1a37f051eeac tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:16.305551 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-85eed84c-e0e2-4ba3-9de8-1a37f051eeac tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:16.312741 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-85eed84c-e0e2-4ba3-9de8-1a37f051eeac tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:16.316303 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-85eed84c-e0e2-4ba3-9de8-1a37f051eeac tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:16.317236 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-85eed84c-e0e2-4ba3-9de8-1a37f051eeac tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:16.318025 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-85eed84c-e0e2-4ba3-9de8-1a37f051eeac tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:16.435562 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-85eed84c-e0e2-4ba3-9de8-1a37f051eeac tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 30806 microversion: 2.1 time: 0.136194 Oct 12 18:28:16.436488 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 199/397] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:28:16 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 30806 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:28:16.493153 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-87cce6e1-db5a-4cd4-b89b-9a1f48802d7d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:16.494406 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-87cce6e1-db5a-4cd4-b89b-9a1f48802d7d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:16.503783 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-87cce6e1-db5a-4cd4-b89b-9a1f48802d7d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:16.504526 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-87cce6e1-db5a-4cd4-b89b-9a1f48802d7d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:16.505557 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-87cce6e1-db5a-4cd4-b89b-9a1f48802d7d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:16.506349 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-87cce6e1-db5a-4cd4-b89b-9a1f48802d7d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:16.636940 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ab5a9f84-a27f-4c78-bf7c-c6b57cee4c37 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:16.638041 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ab5a9f84-a27f-4c78-bf7c-c6b57cee4c37 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:16.646411 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ab5a9f84-a27f-4c78-bf7c-c6b57cee4c37 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:16.646858 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ab5a9f84-a27f-4c78-bf7c-c6b57cee4c37 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:16.647825 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ab5a9f84-a27f-4c78-bf7c-c6b57cee4c37 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:16.648435 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ab5a9f84-a27f-4c78-bf7c-c6b57cee4c37 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:16.662368 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-87cce6e1-db5a-4cd4-b89b-9a1f48802d7d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:16.671777 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-87cce6e1-db5a-4cd4-b89b-9a1f48802d7d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.183882 Oct 12 18:28:16.682405 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 199/398] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:16 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:16.743143 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ab5a9f84-a27f-4c78-bf7c-c6b57cee4c37 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 0.110160 Oct 12 18:28:16.744071 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 200/399] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:16 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:28:17.142955 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-5bb0608f-42cd-4ccf-8899-cb950dbd87b9 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:17.143595 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-5bb0608f-42cd-4ccf-8899-cb950dbd87b9 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: d837950a-354a-44a9-9796-2049507a2225] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:17.162105 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5bb0608f-42cd-4ccf-8899-cb950dbd87b9 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:17.163527 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5bb0608f-42cd-4ccf-8899-cb950dbd87b9 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:17.164298 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5bb0608f-42cd-4ccf-8899-cb950dbd87b9 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:17.164708 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5bb0608f-42cd-4ccf-8899-cb950dbd87b9 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:17.305438 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-5bb0608f-42cd-4ccf-8899-cb950dbd87b9 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:17.313672 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-5bb0608f-42cd-4ccf-8899-cb950dbd87b9 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225" status: 200 len: 1503 microversion: 2.1 time: 0.175898 Oct 12 18:28:17.314239 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 200/400] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:17 2021] GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225 => generated 1503 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:17.448770 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-065a9302-00de-4d57-93b2-1cf75a911fca tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:17.450445 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-065a9302-00de-4d57-93b2-1cf75a911fca tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:17.458673 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-065a9302-00de-4d57-93b2-1cf75a911fca tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:17.459875 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-065a9302-00de-4d57-93b2-1cf75a911fca tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:17.461154 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-065a9302-00de-4d57-93b2-1cf75a911fca tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:17.461736 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-065a9302-00de-4d57-93b2-1cf75a911fca tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:17.560258 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-065a9302-00de-4d57-93b2-1cf75a911fca tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 31532 microversion: 2.1 time: 0.115446 Oct 12 18:28:17.562213 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 201/401] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:28:17 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 31532 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:28:17.711205 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-6317b7b6-0ca3-45bb-9930-abc779881fcc tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:17.711759 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-6317b7b6-0ca3-45bb-9930-abc779881fcc tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:17.718003 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6317b7b6-0ca3-45bb-9930-abc779881fcc tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:17.718442 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6317b7b6-0ca3-45bb-9930-abc779881fcc tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:17.719429 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6317b7b6-0ca3-45bb-9930-abc779881fcc tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:17.719860 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6317b7b6-0ca3-45bb-9930-abc779881fcc tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:17.765614 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0c55920c-0fb8-4837-aa17-1491e10b2470 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:17.766826 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0c55920c-0fb8-4837-aa17-1491e10b2470 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:17.774336 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0c55920c-0fb8-4837-aa17-1491e10b2470 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:17.774869 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0c55920c-0fb8-4837-aa17-1491e10b2470 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:17.775732 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0c55920c-0fb8-4837-aa17-1491e10b2470 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:17.776918 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0c55920c-0fb8-4837-aa17-1491e10b2470 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:17.855834 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0c55920c-0fb8-4837-aa17-1491e10b2470 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 0.103076 Oct 12 18:28:17.857190 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 202/402] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:17 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:28:17.863920 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-6317b7b6-0ca3-45bb-9930-abc779881fcc tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:17.871316 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-6317b7b6-0ca3-45bb-9930-abc779881fcc tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.172379 Oct 12 18:28:17.872441 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 201/403] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:17 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:28:18.331880 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b0078aa6-2c21-4e25-a589-c3871e2a7715 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:18.332793 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b0078aa6-2c21-4e25-a589-c3871e2a7715 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: d837950a-354a-44a9-9796-2049507a2225] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:18.339475 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b0078aa6-2c21-4e25-a589-c3871e2a7715 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:18.339929 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b0078aa6-2c21-4e25-a589-c3871e2a7715 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:18.340802 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b0078aa6-2c21-4e25-a589-c3871e2a7715 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:18.341305 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b0078aa6-2c21-4e25-a589-c3871e2a7715 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:18.494535 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b0078aa6-2c21-4e25-a589-c3871e2a7715 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:18.503826 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b0078aa6-2c21-4e25-a589-c3871e2a7715 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225" status: 200 len: 1503 microversion: 2.1 time: 0.176373 Oct 12 18:28:18.511894 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 203/404] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:18 2021] GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225 => generated 1503 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:18.547117 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-fc44454d-52cd-4265-a777-6fc8187dcf7e req-237af419-1180-4ed2-905f-664350c260d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d837950a-354a-44a9-9796-2049507a2225", "name": "network-vif-deleted", "tag": "7433c711-5359-4625-b8ff-e5942a6a7cf3"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:18.548674 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:28:18.548674 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:28:18.555347 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-fc44454d-52cd-4265-a777-6fc8187dcf7e req-237af419-1180-4ed2-905f-664350c260d9 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:18.555782 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-fc44454d-52cd-4265-a777-6fc8187dcf7e req-237af419-1180-4ed2-905f-664350c260d9 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:18.567072 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-fc44454d-52cd-4265-a777-6fc8187dcf7e req-237af419-1180-4ed2-905f-664350c260d9 service nova] Creating event network-vif-deleted:7433c711-5359-4625-b8ff-e5942a6a7cf3 for instance d837950a-354a-44a9-9796-2049507a2225 on hv-cinder-81322 Oct 12 18:28:18.572086 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-fc44454d-52cd-4265-a777-6fc8187dcf7e req-237af419-1180-4ed2-905f-664350c260d9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028402 Oct 12 18:28:18.579454 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b698cddc-c0e9-4ecb-b2f0-21d43d66aeba tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:18.579454 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b698cddc-c0e9-4ecb-b2f0-21d43d66aeba tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:18.580018 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 202/405] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:28:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:28:18.582309 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b698cddc-c0e9-4ecb-b2f0-21d43d66aeba tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:18.582909 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b698cddc-c0e9-4ecb-b2f0-21d43d66aeba tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:18.583866 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b698cddc-c0e9-4ecb-b2f0-21d43d66aeba tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:18.584691 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b698cddc-c0e9-4ecb-b2f0-21d43d66aeba tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:18.676894 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b698cddc-c0e9-4ecb-b2f0-21d43d66aeba tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 32385 microversion: 2.1 time: 0.106785 Oct 12 18:28:18.677557 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 204/406] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:28:18 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 32385 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:28:18.869901 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-d5e1022a-9676-431a-bb28-b8148d360b6e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:18.871123 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-d5e1022a-9676-431a-bb28-b8148d360b6e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:18.879083 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d5e1022a-9676-431a-bb28-b8148d360b6e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:18.879525 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d5e1022a-9676-431a-bb28-b8148d360b6e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:18.880336 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d5e1022a-9676-431a-bb28-b8148d360b6e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:18.880759 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d5e1022a-9676-431a-bb28-b8148d360b6e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:18.897061 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-704c7e2b-6f9f-4305-9ef7-0b665c4974b0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:18.897061 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-704c7e2b-6f9f-4305-9ef7-0b665c4974b0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:18.900979 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-704c7e2b-6f9f-4305-9ef7-0b665c4974b0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:18.901685 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-704c7e2b-6f9f-4305-9ef7-0b665c4974b0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:18.902470 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-704c7e2b-6f9f-4305-9ef7-0b665c4974b0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:18.902899 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-704c7e2b-6f9f-4305-9ef7-0b665c4974b0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:18.960887 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-d5e1022a-9676-431a-bb28-b8148d360b6e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 0.094934 Oct 12 18:28:18.961532 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 203/407] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:18 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:28:19.038995 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-704c7e2b-6f9f-4305-9ef7-0b665c4974b0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:19.048840 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-704c7e2b-6f9f-4305-9ef7-0b665c4974b0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.160795 Oct 12 18:28:19.049739 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 205/408] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:18 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:19.521476 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-3190d703-6570-4745-9c42-b02da7b674fd tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:19.522170 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-3190d703-6570-4745-9c42-b02da7b674fd tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: d837950a-354a-44a9-9796-2049507a2225] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:19.529471 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3190d703-6570-4745-9c42-b02da7b674fd tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:19.532877 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3190d703-6570-4745-9c42-b02da7b674fd tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:19.532877 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3190d703-6570-4745-9c42-b02da7b674fd tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:19.532877 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3190d703-6570-4745-9c42-b02da7b674fd tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:19.564643 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3190d703-6570-4745-9c42-b02da7b674fd tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:19.565178 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3190d703-6570-4745-9c42-b02da7b674fd tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:19.565640 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.objects.instance [None req-3190d703-6570-4745-9c42-b02da7b674fd tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lazy-loading 'fault' on Instance uuid d837950a-354a-44a9-9796-2049507a2225 {{(pid=109169) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:28:19.608844 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-3190d703-6570-4745-9c42-b02da7b674fd tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac7aaed40f314bf397c414162affa8ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6b4ea245ba455cb3a788ef7907c669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:19.616228 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-3190d703-6570-4745-9c42-b02da7b674fd tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225" status: 200 len: 1304 microversion: 2.1 time: 0.098751 Oct 12 18:28:19.616821 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 204/409] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:19 2021] GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:19.688289 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f2b8ce4a-7b02-4e12-bede-b4cd05198108 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:19.689338 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f2b8ce4a-7b02-4e12-bede-b4cd05198108 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:19.695433 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f2b8ce4a-7b02-4e12-bede-b4cd05198108 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:19.695880 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f2b8ce4a-7b02-4e12-bede-b4cd05198108 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:19.696687 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f2b8ce4a-7b02-4e12-bede-b4cd05198108 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:19.697118 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f2b8ce4a-7b02-4e12-bede-b4cd05198108 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:19.779388 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f2b8ce4a-7b02-4e12-bede-b4cd05198108 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 33292 microversion: 2.1 time: 0.094514 Oct 12 18:28:19.784565 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 206/410] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:28:19 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 33292 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:28:19.974252 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c97ff4bb-ac12-4b89-99d6-dc8f0a411f62 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:19.975152 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c97ff4bb-ac12-4b89-99d6-dc8f0a411f62 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:19.981185 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c97ff4bb-ac12-4b89-99d6-dc8f0a411f62 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:19.981633 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c97ff4bb-ac12-4b89-99d6-dc8f0a411f62 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:19.982427 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c97ff4bb-ac12-4b89-99d6-dc8f0a411f62 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:19.982858 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c97ff4bb-ac12-4b89-99d6-dc8f0a411f62 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:20.068258 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0e8cb6ca-ae7f-415e-992e-7313e896599d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:20.068993 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0e8cb6ca-ae7f-415e-992e-7313e896599d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:20.077775 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0e8cb6ca-ae7f-415e-992e-7313e896599d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:20.079256 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0e8cb6ca-ae7f-415e-992e-7313e896599d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:20.080289 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c97ff4bb-ac12-4b89-99d6-dc8f0a411f62 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 0.108306 Oct 12 18:28:20.080436 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0e8cb6ca-ae7f-415e-992e-7313e896599d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:20.082419 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0e8cb6ca-ae7f-415e-992e-7313e896599d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:20.082545 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 205/411] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:19 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:28:20.212346 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0e8cb6ca-ae7f-415e-992e-7313e896599d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:20.219795 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0e8cb6ca-ae7f-415e-992e-7313e896599d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.157442 Oct 12 18:28:20.220374 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 207/412] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:20 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:28:20.634172 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-f6cc2245-c628-4d62-8f36-0e3a93b5e2e2 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:20.634863 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-f6cc2245-c628-4d62-8f36-0e3a93b5e2e2 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] [instance: d837950a-354a-44a9-9796-2049507a2225] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:20.641810 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f6cc2245-c628-4d62-8f36-0e3a93b5e2e2 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:20.642265 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f6cc2245-c628-4d62-8f36-0e3a93b5e2e2 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:20.643043 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f6cc2245-c628-4d62-8f36-0e3a93b5e2e2 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:20.643468 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f6cc2245-c628-4d62-8f36-0e3a93b5e2e2 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:20.658630 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.wsgi [None req-f6cc2245-c628-4d62-8f36-0e3a93b5e2e2 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] HTTP exception thrown: Instance d837950a-354a-44a9-9796-2049507a2225 could not be found. Oct 12 18:28:20.659197 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-f6cc2245-c628-4d62-8f36-0e3a93b5e2e2 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] Returning 404 to user: Instance d837950a-354a-44a9-9796-2049507a2225 could not be found. {{(pid=109169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:28:20.660151 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-f6cc2245-c628-4d62-8f36-0e3a93b5e2e2 tempest-VolumesActionsTest-1273722044 tempest-VolumesActionsTest-1273722044-project] 10.222.0.18 "GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225" status: 404 len: 111 microversion: 2.1 time: 0.030018 Oct 12 18:28:20.660734 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 206/413] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:20 2021] GET /compute/v2.1/servers/d837950a-354a-44a9-9796-2049507a2225 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:28:20.791011 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-862cd7ce-3996-4a5c-8121-e4e99c143439 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:20.791919 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-862cd7ce-3996-4a5c-8121-e4e99c143439 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:20.798501 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-862cd7ce-3996-4a5c-8121-e4e99c143439 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:20.798894 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-862cd7ce-3996-4a5c-8121-e4e99c143439 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:20.799649 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-862cd7ce-3996-4a5c-8121-e4e99c143439 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:20.800081 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-862cd7ce-3996-4a5c-8121-e4e99c143439 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:20.881949 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-862cd7ce-3996-4a5c-8121-e4e99c143439 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 34201 microversion: 2.1 time: 0.094156 Oct 12 18:28:20.882910 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 208/414] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:28:20 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 34201 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:28:21.093885 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-e528391a-ad28-45e6-8881-a6ed0c289e82 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:21.096012 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-e528391a-ad28-45e6-8881-a6ed0c289e82 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:21.102493 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e528391a-ad28-45e6-8881-a6ed0c289e82 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:21.103001 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e528391a-ad28-45e6-8881-a6ed0c289e82 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:21.103785 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e528391a-ad28-45e6-8881-a6ed0c289e82 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:21.104211 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e528391a-ad28-45e6-8881-a6ed0c289e82 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:21.201930 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-e528391a-ad28-45e6-8881-a6ed0c289e82 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 0.112648 Oct 12 18:28:21.207641 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 207/415] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:21 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:28:21.236944 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e2403f86-93ff-40ad-8cbd-7ed047af89a6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:21.237664 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e2403f86-93ff-40ad-8cbd-7ed047af89a6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:21.244374 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e2403f86-93ff-40ad-8cbd-7ed047af89a6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:21.244788 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e2403f86-93ff-40ad-8cbd-7ed047af89a6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:21.245566 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e2403f86-93ff-40ad-8cbd-7ed047af89a6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:21.245996 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e2403f86-93ff-40ad-8cbd-7ed047af89a6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:21.376689 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e2403f86-93ff-40ad-8cbd-7ed047af89a6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:21.384042 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e2403f86-93ff-40ad-8cbd-7ed047af89a6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.151179 Oct 12 18:28:21.384807 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 209/416] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:21 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:21.896020 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-977f5661-86b2-40b7-8b9e-804cfc870f2a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:21.897108 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-977f5661-86b2-40b7-8b9e-804cfc870f2a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:21.904619 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-977f5661-86b2-40b7-8b9e-804cfc870f2a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:21.905169 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-977f5661-86b2-40b7-8b9e-804cfc870f2a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:21.906228 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-977f5661-86b2-40b7-8b9e-804cfc870f2a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:21.906690 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-977f5661-86b2-40b7-8b9e-804cfc870f2a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:21.981082 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-977f5661-86b2-40b7-8b9e-804cfc870f2a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 35332 microversion: 2.1 time: 0.089419 Oct 12 18:28:21.981724 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 208/417] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:28:21 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 35332 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:28:22.214754 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8a5762e9-bf06-42ab-aa79-18f9c64f2d87 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:22.215753 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8a5762e9-bf06-42ab-aa79-18f9c64f2d87 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:22.221837 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8a5762e9-bf06-42ab-aa79-18f9c64f2d87 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:22.222284 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8a5762e9-bf06-42ab-aa79-18f9c64f2d87 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:22.223052 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8a5762e9-bf06-42ab-aa79-18f9c64f2d87 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:22.223487 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8a5762e9-bf06-42ab-aa79-18f9c64f2d87 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:22.288645 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8a5762e9-bf06-42ab-aa79-18f9c64f2d87 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 28935 microversion: 2.20 time: 0.077399 Oct 12 18:28:22.289277 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 210/418] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:22 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 28935 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:28:22.404869 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-9da37eb6-66a1-41fd-b5ec-2866c159b8d3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:22.405752 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-9da37eb6-66a1-41fd-b5ec-2866c159b8d3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:22.413347 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9da37eb6-66a1-41fd-b5ec-2866c159b8d3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:22.413769 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9da37eb6-66a1-41fd-b5ec-2866c159b8d3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:22.414545 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9da37eb6-66a1-41fd-b5ec-2866c159b8d3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:22.414970 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9da37eb6-66a1-41fd-b5ec-2866c159b8d3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:22.539971 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-9da37eb6-66a1-41fd-b5ec-2866c159b8d3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:22.548808 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-9da37eb6-66a1-41fd-b5ec-2866c159b8d3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.150520 Oct 12 18:28:22.549566 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 209/419] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:22 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:22.994018 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ca79d874-21a0-4356-bb60-b220492eb4fe tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:22.995005 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ca79d874-21a0-4356-bb60-b220492eb4fe tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:23.001788 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ca79d874-21a0-4356-bb60-b220492eb4fe tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:23.002228 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ca79d874-21a0-4356-bb60-b220492eb4fe tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:23.002999 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ca79d874-21a0-4356-bb60-b220492eb4fe tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:23.003415 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ca79d874-21a0-4356-bb60-b220492eb4fe tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:23.085789 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ca79d874-21a0-4356-bb60-b220492eb4fe tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 36454 microversion: 2.1 time: 0.095304 Oct 12 18:28:23.086513 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 211/420] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:28:22 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 36454 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:28:23.300202 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-41e7bd4f-9f60-4b2c-a572-1344026fb85d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:23.301132 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-41e7bd4f-9f60-4b2c-a572-1344026fb85d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:23.307472 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-41e7bd4f-9f60-4b2c-a572-1344026fb85d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:23.307912 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-41e7bd4f-9f60-4b2c-a572-1344026fb85d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:23.308717 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-41e7bd4f-9f60-4b2c-a572-1344026fb85d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:23.309145 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-41e7bd4f-9f60-4b2c-a572-1344026fb85d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:23.399990 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-41e7bd4f-9f60-4b2c-a572-1344026fb85d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 29209 microversion: 2.20 time: 0.103274 Oct 12 18:28:23.400687 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 210/421] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:23 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 29209 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:28:23.568037 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8037c42a-a429-41cd-8f90-262d2136442f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:23.568821 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8037c42a-a429-41cd-8f90-262d2136442f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:23.575127 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8037c42a-a429-41cd-8f90-262d2136442f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:23.575574 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8037c42a-a429-41cd-8f90-262d2136442f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:23.576381 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8037c42a-a429-41cd-8f90-262d2136442f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:23.576840 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8037c42a-a429-41cd-8f90-262d2136442f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:23.699969 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8037c42a-a429-41cd-8f90-262d2136442f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:23.707922 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8037c42a-a429-41cd-8f90-262d2136442f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.144985 Oct 12 18:28:23.708526 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 212/422] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:23 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:28:24.098247 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-51bf9305-6848-4974-9e8c-6365d4589366 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:24.099258 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-51bf9305-6848-4974-9e8c-6365d4589366 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:24.105988 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-51bf9305-6848-4974-9e8c-6365d4589366 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:24.106430 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-51bf9305-6848-4974-9e8c-6365d4589366 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:24.107225 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-51bf9305-6848-4974-9e8c-6365d4589366 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:24.107655 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-51bf9305-6848-4974-9e8c-6365d4589366 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:24.202899 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-51bf9305-6848-4974-9e8c-6365d4589366 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 37295 microversion: 2.1 time: 0.108112 Oct 12 18:28:24.204212 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 211/423] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:28:24 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 37295 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:28:24.411992 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2bacdff6-97de-474b-9f2d-06d315741d2e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:24.412937 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2bacdff6-97de-474b-9f2d-06d315741d2e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:24.418760 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2bacdff6-97de-474b-9f2d-06d315741d2e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:24.419206 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2bacdff6-97de-474b-9f2d-06d315741d2e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:24.419971 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2bacdff6-97de-474b-9f2d-06d315741d2e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:24.420420 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2bacdff6-97de-474b-9f2d-06d315741d2e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:24.517587 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2bacdff6-97de-474b-9f2d-06d315741d2e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 30531 microversion: 2.20 time: 0.109243 Oct 12 18:28:24.518220 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 213/424] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:24 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 30531 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:28:24.725832 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-5d32425a-fe9b-47ea-ac49-239f909008f1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:24.726513 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-5d32425a-fe9b-47ea-ac49-239f909008f1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:24.732868 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5d32425a-fe9b-47ea-ac49-239f909008f1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:24.733307 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5d32425a-fe9b-47ea-ac49-239f909008f1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:24.734061 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5d32425a-fe9b-47ea-ac49-239f909008f1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:24.734486 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5d32425a-fe9b-47ea-ac49-239f909008f1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:24.862523 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-5d32425a-fe9b-47ea-ac49-239f909008f1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:24.870532 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-5d32425a-fe9b-47ea-ac49-239f909008f1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.148472 Oct 12 18:28:24.871035 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 212/425] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:24 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:28:25.216903 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7881777c-dd19-4543-8350-0ff9840b84e7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:25.218283 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7881777c-dd19-4543-8350-0ff9840b84e7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:25.227616 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7881777c-dd19-4543-8350-0ff9840b84e7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:25.228065 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7881777c-dd19-4543-8350-0ff9840b84e7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:25.228923 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7881777c-dd19-4543-8350-0ff9840b84e7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:25.229418 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7881777c-dd19-4543-8350-0ff9840b84e7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:25.303579 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7881777c-dd19-4543-8350-0ff9840b84e7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 38188 microversion: 2.1 time: 0.091271 Oct 12 18:28:25.304222 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 214/426] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:28:25 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 38188 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:28:25.531790 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-9e0c118c-e351-4b73-a0e0-80f2233778e8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:25.532941 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-9e0c118c-e351-4b73-a0e0-80f2233778e8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:25.539394 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9e0c118c-e351-4b73-a0e0-80f2233778e8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:25.539849 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9e0c118c-e351-4b73-a0e0-80f2233778e8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:25.540669 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9e0c118c-e351-4b73-a0e0-80f2233778e8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:25.541290 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9e0c118c-e351-4b73-a0e0-80f2233778e8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:25.632426 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-9e0c118c-e351-4b73-a0e0-80f2233778e8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 31813 microversion: 2.20 time: 0.105129 Oct 12 18:28:25.633135 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 213/427] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:25 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 31813 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:28:25.888117 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-31e58bc7-4b3d-45d3-a9b6-0a97dcf15d1f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:25.888832 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-31e58bc7-4b3d-45d3-a9b6-0a97dcf15d1f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:25.895497 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-31e58bc7-4b3d-45d3-a9b6-0a97dcf15d1f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:25.895939 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-31e58bc7-4b3d-45d3-a9b6-0a97dcf15d1f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:25.896735 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-31e58bc7-4b3d-45d3-a9b6-0a97dcf15d1f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:25.897174 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-31e58bc7-4b3d-45d3-a9b6-0a97dcf15d1f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:26.022196 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-31e58bc7-4b3d-45d3-a9b6-0a97dcf15d1f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:26.030576 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-31e58bc7-4b3d-45d3-a9b6-0a97dcf15d1f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.146410 Oct 12 18:28:26.031219 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 215/428] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:25 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:26.316022 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-f75c5528-d497-45fe-b062-db44e1250390 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:26.317041 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-f75c5528-d497-45fe-b062-db44e1250390 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:26.323585 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f75c5528-d497-45fe-b062-db44e1250390 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:26.324028 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f75c5528-d497-45fe-b062-db44e1250390 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:26.324827 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f75c5528-d497-45fe-b062-db44e1250390 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:26.325258 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f75c5528-d497-45fe-b062-db44e1250390 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:26.400324 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-f75c5528-d497-45fe-b062-db44e1250390 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 38188 microversion: 2.1 time: 0.088132 Oct 12 18:28:26.401066 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 214/429] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:28:26 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 38188 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:28:26.644126 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-733fd221-66d0-4bfc-989c-7ce8ad0c188b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:26.645193 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-733fd221-66d0-4bfc-989c-7ce8ad0c188b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:26.650962 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-733fd221-66d0-4bfc-989c-7ce8ad0c188b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:26.651668 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-733fd221-66d0-4bfc-989c-7ce8ad0c188b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:26.652441 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-733fd221-66d0-4bfc-989c-7ce8ad0c188b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:26.652876 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-733fd221-66d0-4bfc-989c-7ce8ad0c188b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:26.744094 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-733fd221-66d0-4bfc-989c-7ce8ad0c188b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 33117 microversion: 2.20 time: 0.103238 Oct 12 18:28:26.744995 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 216/430] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:26 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 33117 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:28:27.049339 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-84c8e8d2-7f2b-4e83-a4a9-4e23dc893a5e tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:27.050084 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-84c8e8d2-7f2b-4e83-a4a9-4e23dc893a5e tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:27.057218 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-84c8e8d2-7f2b-4e83-a4a9-4e23dc893a5e tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:27.057669 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-84c8e8d2-7f2b-4e83-a4a9-4e23dc893a5e tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:27.062115 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-84c8e8d2-7f2b-4e83-a4a9-4e23dc893a5e tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:27.062115 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-84c8e8d2-7f2b-4e83-a4a9-4e23dc893a5e tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:27.184335 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-84c8e8d2-7f2b-4e83-a4a9-4e23dc893a5e tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:27.191780 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-84c8e8d2-7f2b-4e83-a4a9-4e23dc893a5e tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.146988 Oct 12 18:28:27.192340 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 215/431] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:27 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:27.415002 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e0183ea9-a69b-4274-a34e-24f004cc055d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:27.415979 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e0183ea9-a69b-4274-a34e-24f004cc055d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:27.422334 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e0183ea9-a69b-4274-a34e-24f004cc055d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:27.422776 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e0183ea9-a69b-4274-a34e-24f004cc055d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:27.423562 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e0183ea9-a69b-4274-a34e-24f004cc055d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:27.423988 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e0183ea9-a69b-4274-a34e-24f004cc055d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:27.514140 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e0183ea9-a69b-4274-a34e-24f004cc055d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 38188 microversion: 2.1 time: 0.102912 Oct 12 18:28:27.514805 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 217/432] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:28:27 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 38188 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:28:27.756829 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-d569e0b3-9cf3-4ea4-874f-7b3aa26b8214 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:27.757743 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-d569e0b3-9cf3-4ea4-874f-7b3aa26b8214 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:27.763597 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d569e0b3-9cf3-4ea4-874f-7b3aa26b8214 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:27.764060 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d569e0b3-9cf3-4ea4-874f-7b3aa26b8214 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:27.764840 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d569e0b3-9cf3-4ea4-874f-7b3aa26b8214 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:27.765266 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d569e0b3-9cf3-4ea4-874f-7b3aa26b8214 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:27.848328 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-d569e0b3-9cf3-4ea4-874f-7b3aa26b8214 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 33758 microversion: 2.20 time: 0.094952 Oct 12 18:28:27.849082 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 216/433] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:27 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 33758 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:28:28.211029 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a1f271c3-d8cf-4f15-b89c-b90d880f6826 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:28.211720 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a1f271c3-d8cf-4f15-b89c-b90d880f6826 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:28.219881 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a1f271c3-d8cf-4f15-b89c-b90d880f6826 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:28.221895 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a1f271c3-d8cf-4f15-b89c-b90d880f6826 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:28.222747 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a1f271c3-d8cf-4f15-b89c-b90d880f6826 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:28.223188 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a1f271c3-d8cf-4f15-b89c-b90d880f6826 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:28.349150 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a1f271c3-d8cf-4f15-b89c-b90d880f6826 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:28.358873 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a1f271c3-d8cf-4f15-b89c-b90d880f6826 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.152798 Oct 12 18:28:28.359437 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 218/434] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:28 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:28.530477 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-ce2f9779-5e16-4d2a-aa6c-25bfffcc2dc1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:28.531518 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-ce2f9779-5e16-4d2a-aa6c-25bfffcc2dc1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:28.538343 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ce2f9779-5e16-4d2a-aa6c-25bfffcc2dc1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:28.538785 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ce2f9779-5e16-4d2a-aa6c-25bfffcc2dc1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:28.539744 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ce2f9779-5e16-4d2a-aa6c-25bfffcc2dc1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:28.540157 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ce2f9779-5e16-4d2a-aa6c-25bfffcc2dc1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:28.631551 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-ce2f9779-5e16-4d2a-aa6c-25bfffcc2dc1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 200 len: 38319 microversion: 2.1 time: 0.108287 Oct 12 18:28:28.632199 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 217/435] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:28:28 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 38319 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:28:28.645172 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-36c95261-09d0-4169-8059-927a37488308 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:28.645693 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-36c95261-09d0-4169-8059-927a37488308 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:28.652073 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-36c95261-09d0-4169-8059-927a37488308 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:28.652552 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-36c95261-09d0-4169-8059-927a37488308 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:28.653332 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-36c95261-09d0-4169-8059-927a37488308 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:28.653763 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-36c95261-09d0-4169-8059-927a37488308 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:28.678074 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-36c95261-09d0-4169-8059-927a37488308 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/ips" status: 200 len: 146 microversion: 2.1 time: 0.037381 Oct 12 18:28:28.678700 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 219/436] 10.222.0.18 () {58 vars in 1247 bytes} [Tue Oct 12 18:28:28 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:28:28.862011 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-9720f50d-35bc-4264-aa2b-7ad87721fe80 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:28.863307 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-9720f50d-35bc-4264-aa2b-7ad87721fe80 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:28.871593 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9720f50d-35bc-4264-aa2b-7ad87721fe80 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:28.872038 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9720f50d-35bc-4264-aa2b-7ad87721fe80 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:28.872891 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9720f50d-35bc-4264-aa2b-7ad87721fe80 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:28.873319 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9720f50d-35bc-4264-aa2b-7ad87721fe80 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:28.964642 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-9720f50d-35bc-4264-aa2b-7ad87721fe80 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 34508 microversion: 2.20 time: 0.107278 Oct 12 18:28:28.965552 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 218/437] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:28 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 34508 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:28:29.376928 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2edbf04f-6709-4101-b76a-a34416734650 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:29.378090 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2edbf04f-6709-4101-b76a-a34416734650 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:29.385502 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2edbf04f-6709-4101-b76a-a34416734650 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:29.385944 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2edbf04f-6709-4101-b76a-a34416734650 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:29.386780 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2edbf04f-6709-4101-b76a-a34416734650 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:29.387327 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2edbf04f-6709-4101-b76a-a34416734650 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:29.512947 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2edbf04f-6709-4101-b76a-a34416734650 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:29.520814 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2edbf04f-6709-4101-b76a-a34416734650 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.149073 Oct 12 18:28:29.521376 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 220/438] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:29 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:28:29.977442 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-99e06951-6efc-416c-8e1e-5f3999789705 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:29.978469 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-99e06951-6efc-416c-8e1e-5f3999789705 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:29.985177 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-99e06951-6efc-416c-8e1e-5f3999789705 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:29.985706 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-99e06951-6efc-416c-8e1e-5f3999789705 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:29.986568 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-99e06951-6efc-416c-8e1e-5f3999789705 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:29.987072 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-99e06951-6efc-416c-8e1e-5f3999789705 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:30.066396 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-99e06951-6efc-416c-8e1e-5f3999789705 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 35409 microversion: 2.20 time: 0.092832 Oct 12 18:28:30.067175 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 219/439] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:29 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 35409 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:28:30.538470 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-912daf84-ee5a-4567-9b23-45657412e9ef tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:30.539085 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-912daf84-ee5a-4567-9b23-45657412e9ef tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:30.545885 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-912daf84-ee5a-4567-9b23-45657412e9ef tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:30.549326 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-912daf84-ee5a-4567-9b23-45657412e9ef tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:30.549326 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-912daf84-ee5a-4567-9b23-45657412e9ef tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:30.549326 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-912daf84-ee5a-4567-9b23-45657412e9ef tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:30.687669 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-912daf84-ee5a-4567-9b23-45657412e9ef tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:30.698690 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-912daf84-ee5a-4567-9b23-45657412e9ef tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.161083 Oct 12 18:28:30.698690 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 221/440] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:30 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:31.080427 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-f050a6c0-9760-4b2e-96dc-3b093206d030 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:31.081445 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-f050a6c0-9760-4b2e-96dc-3b093206d030 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:31.087968 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f050a6c0-9760-4b2e-96dc-3b093206d030 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:31.088437 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f050a6c0-9760-4b2e-96dc-3b093206d030 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:31.089206 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f050a6c0-9760-4b2e-96dc-3b093206d030 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:31.089636 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f050a6c0-9760-4b2e-96dc-3b093206d030 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:31.172887 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-f050a6c0-9760-4b2e-96dc-3b093206d030 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 36603 microversion: 2.20 time: 0.096967 Oct 12 18:28:31.173507 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 220/441] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:31 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 36603 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:28:31.715088 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-74e9304b-14d9-4543-ac4e-8fdc00082239 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:31.715775 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-74e9304b-14d9-4543-ac4e-8fdc00082239 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:31.724053 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-74e9304b-14d9-4543-ac4e-8fdc00082239 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:31.724861 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-74e9304b-14d9-4543-ac4e-8fdc00082239 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:31.725843 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-74e9304b-14d9-4543-ac4e-8fdc00082239 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:31.726362 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-74e9304b-14d9-4543-ac4e-8fdc00082239 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:31.862286 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-74e9304b-14d9-4543-ac4e-8fdc00082239 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:31.869795 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-74e9304b-14d9-4543-ac4e-8fdc00082239 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.159164 Oct 12 18:28:31.870298 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 222/442] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:31 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:32.187978 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-ee591b2c-c2a4-409c-8f83-606b72aac509 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:32.189994 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-ee591b2c-c2a4-409c-8f83-606b72aac509 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:32.201534 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ee591b2c-c2a4-409c-8f83-606b72aac509 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:32.202323 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ee591b2c-c2a4-409c-8f83-606b72aac509 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:32.203210 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ee591b2c-c2a4-409c-8f83-606b72aac509 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:32.203673 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ee591b2c-c2a4-409c-8f83-606b72aac509 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:32.290998 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-ee591b2c-c2a4-409c-8f83-606b72aac509 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 37906 microversion: 2.20 time: 0.108801 Oct 12 18:28:32.291682 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 221/443] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:32 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 37906 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:28:32.721943 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a5aa9c4b-657c-42dd-9e67-5e232a6e4822 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "301df3e6-d14c-4ee2-869b-c604e4a3ecce"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:32.736438 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a5aa9c4b-657c-42dd-9e67-5e232a6e4822 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:32.736438 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a5aa9c4b-657c-42dd-9e67-5e232a6e4822 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:32.736438 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a5aa9c4b-657c-42dd-9e67-5e232a6e4822 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:32.736438 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a5aa9c4b-657c-42dd-9e67-5e232a6e4822 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:32.737055 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a5aa9c4b-657c-42dd-9e67-5e232a6e4822 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:32.892308 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-90baf54a-5b42-4ee0-8c41-e0e2a7abc6f4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:32.893805 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-90baf54a-5b42-4ee0-8c41-e0e2a7abc6f4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:32.903848 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-90baf54a-5b42-4ee0-8c41-e0e2a7abc6f4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:32.904289 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-90baf54a-5b42-4ee0-8c41-e0e2a7abc6f4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:32.905099 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-90baf54a-5b42-4ee0-8c41-e0e2a7abc6f4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:32.905533 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-90baf54a-5b42-4ee0-8c41-e0e2a7abc6f4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:33.042491 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-90baf54a-5b42-4ee0-8c41-e0e2a7abc6f4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:33.050803 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-90baf54a-5b42-4ee0-8c41-e0e2a7abc6f4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.165407 Oct 12 18:28:33.051408 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 222/444] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:32 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:33.303532 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-66892ee3-9d42-4d9d-8919-245f13f5dc9a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:33.304461 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-66892ee3-9d42-4d9d-8919-245f13f5dc9a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:33.310150 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-66892ee3-9d42-4d9d-8919-245f13f5dc9a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:33.310594 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-66892ee3-9d42-4d9d-8919-245f13f5dc9a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:33.311363 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-66892ee3-9d42-4d9d-8919-245f13f5dc9a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:33.311783 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-66892ee3-9d42-4d9d-8919-245f13f5dc9a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:33.397852 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-66892ee3-9d42-4d9d-8919-245f13f5dc9a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 38491 microversion: 2.20 time: 0.098100 Oct 12 18:28:33.398795 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 223/445] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:33 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 38491 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:28:33.644525 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a5aa9c4b-657c-42dd-9e67-5e232a6e4822 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.926937 Oct 12 18:28:33.645667 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 223/446] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Oct 12 18:28:32 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/os-volume_attachments => generated 194 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:28:34.069532 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-a637f8f9-1838-437d-bd1c-3cb8c50eb7a1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:34.070310 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-a637f8f9-1838-437d-bd1c-3cb8c50eb7a1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:34.076858 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a637f8f9-1838-437d-bd1c-3cb8c50eb7a1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:34.077304 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a637f8f9-1838-437d-bd1c-3cb8c50eb7a1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:34.078075 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a637f8f9-1838-437d-bd1c-3cb8c50eb7a1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:34.078507 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a637f8f9-1838-437d-bd1c-3cb8c50eb7a1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:34.210370 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-a637f8f9-1838-437d-bd1c-3cb8c50eb7a1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:34.218050 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-a637f8f9-1838-437d-bd1c-3cb8c50eb7a1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.152561 Oct 12 18:28:34.218619 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 224/447] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:34 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:28:34.416812 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7771dce5-0ae3-41d6-ac53-dfd750f74719 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:34.417838 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7771dce5-0ae3-41d6-ac53-dfd750f74719 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:34.424631 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7771dce5-0ae3-41d6-ac53-dfd750f74719 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:34.425080 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7771dce5-0ae3-41d6-ac53-dfd750f74719 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:34.425876 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7771dce5-0ae3-41d6-ac53-dfd750f74719 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:34.426318 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7771dce5-0ae3-41d6-ac53-dfd750f74719 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:34.505589 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7771dce5-0ae3-41d6-ac53-dfd750f74719 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 38491 microversion: 2.20 time: 0.094290 Oct 12 18:28:34.506289 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 224/448] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:34 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 38491 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:28:35.236358 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-b9549c41-65af-4b3f-9e08-92030d07d037 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:35.237033 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-b9549c41-65af-4b3f-9e08-92030d07d037 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:35.244144 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b9549c41-65af-4b3f-9e08-92030d07d037 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:35.244697 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b9549c41-65af-4b3f-9e08-92030d07d037 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:35.245480 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b9549c41-65af-4b3f-9e08-92030d07d037 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:35.245912 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b9549c41-65af-4b3f-9e08-92030d07d037 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:35.377426 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-b9549c41-65af-4b3f-9e08-92030d07d037 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:35.384953 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-b9549c41-65af-4b3f-9e08-92030d07d037 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.152252 Oct 12 18:28:35.385530 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 225/449] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:35 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:35.518903 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5fe19b0f-3ac6-4663-adbd-4a5f334d4ae6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:35.519910 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5fe19b0f-3ac6-4663-adbd-4a5f334d4ae6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:35.526905 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5fe19b0f-3ac6-4663-adbd-4a5f334d4ae6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:35.527329 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5fe19b0f-3ac6-4663-adbd-4a5f334d4ae6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:35.528105 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5fe19b0f-3ac6-4663-adbd-4a5f334d4ae6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:35.528584 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5fe19b0f-3ac6-4663-adbd-4a5f334d4ae6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:35.599851 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5fe19b0f-3ac6-4663-adbd-4a5f334d4ae6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 38491 microversion: 2.20 time: 0.085278 Oct 12 18:28:35.601002 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 225/450] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:35 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 38491 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:28:36.402563 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-7c7eeb81-8ce8-4e1f-9567-0d6b6c5f691c tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:36.403225 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-7c7eeb81-8ce8-4e1f-9567-0d6b6c5f691c tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:36.411032 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7c7eeb81-8ce8-4e1f-9567-0d6b6c5f691c tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:36.411936 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7c7eeb81-8ce8-4e1f-9567-0d6b6c5f691c tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:36.413282 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7c7eeb81-8ce8-4e1f-9567-0d6b6c5f691c tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:36.413890 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7c7eeb81-8ce8-4e1f-9567-0d6b6c5f691c tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:36.543225 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-7c7eeb81-8ce8-4e1f-9567-0d6b6c5f691c tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:36.551976 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-7c7eeb81-8ce8-4e1f-9567-0d6b6c5f691c tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.153288 Oct 12 18:28:36.552578 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 226/451] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:36 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:36.613934 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2e008d05-3fc9-49ca-8878-76e48fec5ea9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:36.614878 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2e008d05-3fc9-49ca-8878-76e48fec5ea9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:36.621701 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2e008d05-3fc9-49ca-8878-76e48fec5ea9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:36.622138 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2e008d05-3fc9-49ca-8878-76e48fec5ea9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:36.622925 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2e008d05-3fc9-49ca-8878-76e48fec5ea9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:36.623362 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2e008d05-3fc9-49ca-8878-76e48fec5ea9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:36.689993 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2e008d05-3fc9-49ca-8878-76e48fec5ea9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 38491 microversion: 2.20 time: 0.080241 Oct 12 18:28:36.690701 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 226/452] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:36 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 38491 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:28:37.568892 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-660729ea-ac23-44b2-93e7-e93ed86cb48f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:37.569449 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-660729ea-ac23-44b2-93e7-e93ed86cb48f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:37.575634 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-660729ea-ac23-44b2-93e7-e93ed86cb48f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:37.576081 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-660729ea-ac23-44b2-93e7-e93ed86cb48f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:37.576898 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-660729ea-ac23-44b2-93e7-e93ed86cb48f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:37.577342 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-660729ea-ac23-44b2-93e7-e93ed86cb48f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:37.704957 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-456237b1-be46-4fab-9e1d-dc2cea62b7bc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:37.706659 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-456237b1-be46-4fab-9e1d-dc2cea62b7bc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:37.711157 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-660729ea-ac23-44b2-93e7-e93ed86cb48f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:37.713217 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-456237b1-be46-4fab-9e1d-dc2cea62b7bc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:37.713677 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-456237b1-be46-4fab-9e1d-dc2cea62b7bc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:37.714453 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-456237b1-be46-4fab-9e1d-dc2cea62b7bc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:37.714878 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-456237b1-be46-4fab-9e1d-dc2cea62b7bc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:37.718684 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-660729ea-ac23-44b2-93e7-e93ed86cb48f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.153545 Oct 12 18:28:37.719289 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 227/453] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:37 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:38.736199 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-47ee7fb8-d9ab-4475-b4aa-398b5b85fcee tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:38.737458 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-47ee7fb8-d9ab-4475-b4aa-398b5b85fcee tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:38.744042 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-47ee7fb8-d9ab-4475-b4aa-398b5b85fcee tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:38.744860 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-47ee7fb8-d9ab-4475-b4aa-398b5b85fcee tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:38.746316 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-47ee7fb8-d9ab-4475-b4aa-398b5b85fcee tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:38.747044 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-47ee7fb8-d9ab-4475-b4aa-398b5b85fcee tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:38.885925 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-47ee7fb8-d9ab-4475-b4aa-398b5b85fcee tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:38.896894 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-47ee7fb8-d9ab-4475-b4aa-398b5b85fcee tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.162310 Oct 12 18:28:38.896894 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 228/454] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:38 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:28:39.918806 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-cc2f56aa-ac7c-4327-ba00-f751a2aabbd0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:39.919445 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-cc2f56aa-ac7c-4327-ba00-f751a2aabbd0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:39.926053 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cc2f56aa-ac7c-4327-ba00-f751a2aabbd0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:39.926584 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cc2f56aa-ac7c-4327-ba00-f751a2aabbd0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:39.927435 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cc2f56aa-ac7c-4327-ba00-f751a2aabbd0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:39.927903 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cc2f56aa-ac7c-4327-ba00-f751a2aabbd0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:40.061498 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-cc2f56aa-ac7c-4327-ba00-f751a2aabbd0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:40.070811 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-cc2f56aa-ac7c-4327-ba00-f751a2aabbd0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.156097 Oct 12 18:28:40.071694 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 229/455] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:39 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:41.094615 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c71455b6-a0d9-48da-afd5-13d196483b0a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:41.095158 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c71455b6-a0d9-48da-afd5-13d196483b0a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:41.101398 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c71455b6-a0d9-48da-afd5-13d196483b0a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:41.102124 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c71455b6-a0d9-48da-afd5-13d196483b0a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:41.103096 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c71455b6-a0d9-48da-afd5-13d196483b0a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:41.103718 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c71455b6-a0d9-48da-afd5-13d196483b0a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:41.236115 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c71455b6-a0d9-48da-afd5-13d196483b0a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:41.243985 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c71455b6-a0d9-48da-afd5-13d196483b0a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.152768 Oct 12 18:28:41.244424 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 230/456] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:41 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:28:42.266124 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-339256d1-dd92-4d8a-84ad-e420ac9a56a6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:42.266735 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-339256d1-dd92-4d8a-84ad-e420ac9a56a6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:42.272878 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-339256d1-dd92-4d8a-84ad-e420ac9a56a6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:42.273324 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-339256d1-dd92-4d8a-84ad-e420ac9a56a6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:42.274086 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-339256d1-dd92-4d8a-84ad-e420ac9a56a6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:42.274528 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-339256d1-dd92-4d8a-84ad-e420ac9a56a6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:42.393059 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-339256d1-dd92-4d8a-84ad-e420ac9a56a6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:42.400232 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-339256d1-dd92-4d8a-84ad-e420ac9a56a6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.137724 Oct 12 18:28:42.400816 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 231/457] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:42 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:28:43.419002 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-3acd0e01-5b2b-480a-a9a3-50bdbfd65f7a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:43.419635 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-3acd0e01-5b2b-480a-a9a3-50bdbfd65f7a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:43.426250 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3acd0e01-5b2b-480a-a9a3-50bdbfd65f7a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:43.426688 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3acd0e01-5b2b-480a-a9a3-50bdbfd65f7a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:43.427456 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3acd0e01-5b2b-480a-a9a3-50bdbfd65f7a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:43.427883 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3acd0e01-5b2b-480a-a9a3-50bdbfd65f7a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:43.561491 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-3acd0e01-5b2b-480a-a9a3-50bdbfd65f7a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:43.572074 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-3acd0e01-5b2b-480a-a9a3-50bdbfd65f7a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.156439 Oct 12 18:28:43.573180 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 232/458] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:43 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:28:44.227611 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-456237b1-be46-4fab-9e1d-dc2cea62b7bc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 200 len: 38634 microversion: 2.20 time: 6.524267 Oct 12 18:28:44.227611 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 227/459] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:37 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 38634 bytes in 6526 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:28:44.237454 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-85180edd-ca9e-44dd-9ca0-bf9fff66e6c1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:44.237934 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-85180edd-ca9e-44dd-9ca0-bf9fff66e6c1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:44.244011 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-85180edd-ca9e-44dd-9ca0-bf9fff66e6c1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:44.244440 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-85180edd-ca9e-44dd-9ca0-bf9fff66e6c1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:44.245051 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-85180edd-ca9e-44dd-9ca0-bf9fff66e6c1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:44.245476 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-85180edd-ca9e-44dd-9ca0-bf9fff66e6c1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:44.274483 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-85180edd-ca9e-44dd-9ca0-bf9fff66e6c1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/ips" status: 200 len: 151 microversion: 2.20 time: 0.040962 Oct 12 18:28:44.275223 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 233/460] 10.222.0.18 () {60 vars in 1288 bytes} [Tue Oct 12 18:28:44 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:28:44.590060 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-04eb4669-8a4f-4ce6-a503-586e7f8a5165 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:44.590767 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-04eb4669-8a4f-4ce6-a503-586e7f8a5165 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:44.597247 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-04eb4669-8a4f-4ce6-a503-586e7f8a5165 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:44.597738 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-04eb4669-8a4f-4ce6-a503-586e7f8a5165 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:44.598498 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-04eb4669-8a4f-4ce6-a503-586e7f8a5165 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:44.598924 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-04eb4669-8a4f-4ce6-a503-586e7f8a5165 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:44.729001 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-04eb4669-8a4f-4ce6-a503-586e7f8a5165 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:44.738101 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-04eb4669-8a4f-4ce6-a503-586e7f8a5165 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.151517 Oct 12 18:28:44.738635 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 228/461] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:44 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:45.754790 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-860ec20f-557d-4c26-8e02-f239143bfda1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:45.755390 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-860ec20f-557d-4c26-8e02-f239143bfda1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:45.761260 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-860ec20f-557d-4c26-8e02-f239143bfda1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:45.761708 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-860ec20f-557d-4c26-8e02-f239143bfda1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:45.762452 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-860ec20f-557d-4c26-8e02-f239143bfda1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:45.763029 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-860ec20f-557d-4c26-8e02-f239143bfda1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:45.884353 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-860ec20f-557d-4c26-8e02-f239143bfda1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:45.892171 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-860ec20f-557d-4c26-8e02-f239143bfda1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.141287 Oct 12 18:28:45.892772 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 234/462] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:45 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:46.503022 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1f49e68d-a9e9-4840-957b-a522a43c02a6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:46.511975 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1f49e68d-a9e9-4840-957b-a522a43c02a6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:46.513905 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1f49e68d-a9e9-4840-957b-a522a43c02a6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:46.597534 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1f49e68d-a9e9-4840-957b-a522a43c02a6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Going to try to stop instance {{(pid=109168) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Oct 12 18:28:46.840705 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1f49e68d-a9e9-4840-957b-a522a43c02a6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 202 len: 0 microversion: 2.1 time: 0.341125 Oct 12 18:28:46.841318 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 229/463] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:28:46 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:28:46.849684 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-5f66eac9-ad40-4379-b17c-d459b4060f03 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:46.850345 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-5f66eac9-ad40-4379-b17c-d459b4060f03 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:46.856216 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5f66eac9-ad40-4379-b17c-d459b4060f03 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:46.856697 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5f66eac9-ad40-4379-b17c-d459b4060f03 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:46.857472 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5f66eac9-ad40-4379-b17c-d459b4060f03 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:46.857902 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5f66eac9-ad40-4379-b17c-d459b4060f03 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:46.910984 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2964f769-fb88-463e-a7a1-f3555e364155 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:46.911579 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2964f769-fb88-463e-a7a1-f3555e364155 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:46.918802 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2964f769-fb88-463e-a7a1-f3555e364155 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:46.919239 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2964f769-fb88-463e-a7a1-f3555e364155 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:46.920015 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2964f769-fb88-463e-a7a1-f3555e364155 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:46.920674 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2964f769-fb88-463e-a7a1-f3555e364155 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:47.009410 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-5f66eac9-ad40-4379-b17c-d459b4060f03 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:47.018071 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-5f66eac9-ad40-4379-b17c-d459b4060f03 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1724 microversion: 2.1 time: 0.172508 Oct 12 18:28:47.020057 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 235/464] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:46 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:47.082189 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2964f769-fb88-463e-a7a1-f3555e364155 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:47.089742 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2964f769-fb88-463e-a7a1-f3555e364155 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.183546 Oct 12 18:28:47.090487 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 230/465] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:46 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:28:48.043205 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-fe376010-9dfe-4229-8fe8-461f8530ec4c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:48.043974 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-fe376010-9dfe-4229-8fe8-461f8530ec4c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:48.052481 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fe376010-9dfe-4229-8fe8-461f8530ec4c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:48.052928 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fe376010-9dfe-4229-8fe8-461f8530ec4c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:48.053711 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fe376010-9dfe-4229-8fe8-461f8530ec4c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:48.054346 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fe376010-9dfe-4229-8fe8-461f8530ec4c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:48.108259 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-53f7c926-2d3c-4676-9250-b8d63581dcc0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:48.109846 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-53f7c926-2d3c-4676-9250-b8d63581dcc0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:48.116931 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-53f7c926-2d3c-4676-9250-b8d63581dcc0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:48.117768 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-53f7c926-2d3c-4676-9250-b8d63581dcc0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:48.118818 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-53f7c926-2d3c-4676-9250-b8d63581dcc0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:48.119663 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-53f7c926-2d3c-4676-9250-b8d63581dcc0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:48.263949 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-fe376010-9dfe-4229-8fe8-461f8530ec4c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:48.308221 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-fe376010-9dfe-4229-8fe8-461f8530ec4c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1724 microversion: 2.1 time: 0.261615 Oct 12 18:28:48.309263 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 236/466] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:48 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1724 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:28:48.361522 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-53f7c926-2d3c-4676-9250-b8d63581dcc0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:48.372300 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-53f7c926-2d3c-4676-9250-b8d63581dcc0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.268676 Oct 12 18:28:48.373572 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 231/467] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:48 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:48.510701 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-2e2a04a9-b463-42a4-ac69-a12451ba7085 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:48.511547 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-2e2a04a9-b463-42a4-ac69-a12451ba7085 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:48.518550 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2e2a04a9-b463-42a4-ac69-a12451ba7085 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:48.518996 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2e2a04a9-b463-42a4-ac69-a12451ba7085 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:48.519847 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2e2a04a9-b463-42a4-ac69-a12451ba7085 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:48.520230 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2e2a04a9-b463-42a4-ac69-a12451ba7085 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:48.556883 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.objects.instance [None req-2e2a04a9-b463-42a4-ac69-a12451ba7085 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lazy-loading 'flavor' on Instance uuid a13e5623-9ecd-4036-b74a-48cbb84908de {{(pid=109169) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:28:49.329354 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-adcf9aad-41c6-4fe9-83e6-3301d35018bf tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:49.330669 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-adcf9aad-41c6-4fe9-83e6-3301d35018bf tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:49.338103 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-adcf9aad-41c6-4fe9-83e6-3301d35018bf tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:49.338823 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-adcf9aad-41c6-4fe9-83e6-3301d35018bf tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:49.339786 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-adcf9aad-41c6-4fe9-83e6-3301d35018bf tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:49.340377 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-adcf9aad-41c6-4fe9-83e6-3301d35018bf tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:49.435323 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-2e2a04a9-b463-42a4-ac69-a12451ba7085 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 202 len: 0 microversion: 2.20 time: 0.926201 Oct 12 18:28:49.439677 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 237/468] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:28:48 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 0 bytes in 930 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 12 18:28:49.450355 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-ea410897-746e-4d16-aa72-00d2c28529cf tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:49.451095 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-ea410897-746e-4d16-aa72-00d2c28529cf tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:49.468455 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ea410897-746e-4d16-aa72-00d2c28529cf tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:49.468455 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ea410897-746e-4d16-aa72-00d2c28529cf tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:49.468455 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ea410897-746e-4d16-aa72-00d2c28529cf tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:49.468455 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ea410897-746e-4d16-aa72-00d2c28529cf tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:49.548947 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-adcf9aad-41c6-4fe9-83e6-3301d35018bf tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:49.556844 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-adcf9aad-41c6-4fe9-83e6-3301d35018bf tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1724 microversion: 2.1 time: 0.231971 Oct 12 18:28:49.559499 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 232/469] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:49 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:28:49.561805 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-405a4341-2573-4bd4-9188-5da60e48272d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:49.562404 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-405a4341-2573-4bd4-9188-5da60e48272d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:49.568728 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-405a4341-2573-4bd4-9188-5da60e48272d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:49.569172 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-405a4341-2573-4bd4-9188-5da60e48272d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:49.570139 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-405a4341-2573-4bd4-9188-5da60e48272d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:49.570572 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-405a4341-2573-4bd4-9188-5da60e48272d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:49.654115 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-ea410897-746e-4d16-aa72-00d2c28529cf tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:49.661974 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-ea410897-746e-4d16-aa72-00d2c28529cf tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1503 microversion: 2.1 time: 0.224609 Oct 12 18:28:49.662753 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 238/470] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:49 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1503 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:49.678530 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-1bae9729-a81b-44e8-a723-d4be44176b11 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "788b1246-6127-4b73-bfed-485660e94b1a"}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:49.679645 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-1bae9729-a81b-44e8-a723-d4be44176b11 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:49.686939 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1bae9729-a81b-44e8-a723-d4be44176b11 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:49.687607 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1bae9729-a81b-44e8-a723-d4be44176b11 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:49.688526 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1bae9729-a81b-44e8-a723-d4be44176b11 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:49.689063 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1bae9729-a81b-44e8-a723-d4be44176b11 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:49.718365 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.wsgi [None req-1bae9729-a81b-44e8-a723-d4be44176b11 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] HTTP exception thrown: Cannot 'attach_volume' instance 4ade368f-e898-4346-83a8-3d3eb86c8192 while it is in vm_state rescued Oct 12 18:28:49.727945 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-1bae9729-a81b-44e8-a723-d4be44176b11 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Returning 409 to user: Cannot 'attach_volume' instance 4ade368f-e898-4346-83a8-3d3eb86c8192 while it is in vm_state rescued {{(pid=109169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:28:49.727945 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-1bae9729-a81b-44e8-a723-d4be44176b11 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "POST /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045309 Oct 12 18:28:49.727945 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 239/471] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Oct 12 18:28:49 2021] POST /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 18:28:49.730066 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-405a4341-2573-4bd4-9188-5da60e48272d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:49.735196 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-2ea0a24f-ddf1-48aa-8eca-25b39524504a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:49.735762 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-2ea0a24f-ddf1-48aa-8eca-25b39524504a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:49.739883 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-405a4341-2573-4bd4-9188-5da60e48272d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:49.741431 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-405a4341-2573-4bd4-9188-5da60e48272d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:49.742793 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-405a4341-2573-4bd4-9188-5da60e48272d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1722 microversion: 2.20 time: 0.184472 Oct 12 18:28:49.743505 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 233/472] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:28:49 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:28:49.753180 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2ea0a24f-ddf1-48aa-8eca-25b39524504a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:49.753180 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2ea0a24f-ddf1-48aa-8eca-25b39524504a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:49.753180 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2ea0a24f-ddf1-48aa-8eca-25b39524504a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:49.753180 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2ea0a24f-ddf1-48aa-8eca-25b39524504a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:50.031572 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-2ea0a24f-ddf1-48aa-8eca-25b39524504a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "POST /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192/action" status: 202 len: 0 microversion: 2.1 time: 0.298645 Oct 12 18:28:50.036849 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 240/473] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:28:49 2021] POST /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:28:50.044782 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1ccd91cd-eaeb-40be-82fe-a319ba038b7b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:50.045394 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1ccd91cd-eaeb-40be-82fe-a319ba038b7b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:50.052875 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1ccd91cd-eaeb-40be-82fe-a319ba038b7b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:50.053683 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1ccd91cd-eaeb-40be-82fe-a319ba038b7b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:50.054647 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1ccd91cd-eaeb-40be-82fe-a319ba038b7b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:50.055073 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1ccd91cd-eaeb-40be-82fe-a319ba038b7b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:50.456966 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1ccd91cd-eaeb-40be-82fe-a319ba038b7b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:50.464446 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1ccd91cd-eaeb-40be-82fe-a319ba038b7b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1511 microversion: 2.1 time: 0.423284 Oct 12 18:28:50.475231 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 234/474] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:50 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1511 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:50.576803 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-90b6dee5-4f27-48bc-b4e6-ed17470694ac tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:50.577658 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-90b6dee5-4f27-48bc-b4e6-ed17470694ac tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:50.584891 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-90b6dee5-4f27-48bc-b4e6-ed17470694ac tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:50.585743 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-90b6dee5-4f27-48bc-b4e6-ed17470694ac tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:50.586755 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-90b6dee5-4f27-48bc-b4e6-ed17470694ac tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:50.587405 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-90b6dee5-4f27-48bc-b4e6-ed17470694ac tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:50.765353 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-cffe9987-fab4-4b8b-81c7-698fab7d979e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:50.766438 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-cffe9987-fab4-4b8b-81c7-698fab7d979e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:50.776212 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cffe9987-fab4-4b8b-81c7-698fab7d979e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:50.776986 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cffe9987-fab4-4b8b-81c7-698fab7d979e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:50.777764 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cffe9987-fab4-4b8b-81c7-698fab7d979e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:50.778190 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cffe9987-fab4-4b8b-81c7-698fab7d979e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:50.816293 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-90b6dee5-4f27-48bc-b4e6-ed17470694ac tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:50.836751 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-90b6dee5-4f27-48bc-b4e6-ed17470694ac tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1724 microversion: 2.1 time: 0.263741 Oct 12 18:28:50.857180 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 241/475] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:50 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1724 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:50.949206 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-cffe9987-fab4-4b8b-81c7-698fab7d979e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:50.962574 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-cffe9987-fab4-4b8b-81c7-698fab7d979e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:50.964860 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-cffe9987-fab4-4b8b-81c7-698fab7d979e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:50.966197 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-cffe9987-fab4-4b8b-81c7-698fab7d979e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1722 microversion: 2.20 time: 0.206867 Oct 12 18:28:50.967476 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 235/476] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:28:50 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:28:51.485583 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-fae71a3b-db07-456f-87e5-626285ec0abf tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:51.486207 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-fae71a3b-db07-456f-87e5-626285ec0abf tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:51.493581 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fae71a3b-db07-456f-87e5-626285ec0abf tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:51.494085 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fae71a3b-db07-456f-87e5-626285ec0abf tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:51.494844 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fae71a3b-db07-456f-87e5-626285ec0abf tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:51.495861 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fae71a3b-db07-456f-87e5-626285ec0abf tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:51.690552 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-fae71a3b-db07-456f-87e5-626285ec0abf tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:51.699477 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-fae71a3b-db07-456f-87e5-626285ec0abf tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1511 microversion: 2.1 time: 0.220782 Oct 12 18:28:51.700058 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 242/477] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:51 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1511 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:51.870680 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-18833374-0328-4595-8f07-28f2735e62e9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:51.871280 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-18833374-0328-4595-8f07-28f2735e62e9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:51.892273 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-18833374-0328-4595-8f07-28f2735e62e9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:51.894638 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-18833374-0328-4595-8f07-28f2735e62e9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:51.895636 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-18833374-0328-4595-8f07-28f2735e62e9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:51.896039 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-18833374-0328-4595-8f07-28f2735e62e9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:51.986398 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-97e8ebd1-ea55-408b-a2dc-7c0a06f011e0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:51.987079 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-97e8ebd1-ea55-408b-a2dc-7c0a06f011e0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:51.993533 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-97e8ebd1-ea55-408b-a2dc-7c0a06f011e0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:51.994245 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-97e8ebd1-ea55-408b-a2dc-7c0a06f011e0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:51.995224 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-97e8ebd1-ea55-408b-a2dc-7c0a06f011e0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:51.995742 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-97e8ebd1-ea55-408b-a2dc-7c0a06f011e0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:52.138435 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-18833374-0328-4595-8f07-28f2735e62e9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:52.150583 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-18833374-0328-4595-8f07-28f2735e62e9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1724 microversion: 2.1 time: 0.284243 Oct 12 18:28:52.152050 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 236/478] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:51 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1724 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:52.202594 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-97e8ebd1-ea55-408b-a2dc-7c0a06f011e0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:52.214496 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-97e8ebd1-ea55-408b-a2dc-7c0a06f011e0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:52.216033 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-97e8ebd1-ea55-408b-a2dc-7c0a06f011e0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:52.217247 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-97e8ebd1-ea55-408b-a2dc-7c0a06f011e0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1722 microversion: 2.20 time: 0.235134 Oct 12 18:28:52.218103 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 243/479] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:28:51 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:28:52.717249 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-df07bc42-655b-45fc-9822-f2f822e8c787 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:52.717871 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-df07bc42-655b-45fc-9822-f2f822e8c787 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:52.728019 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-df07bc42-655b-45fc-9822-f2f822e8c787 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:52.728019 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-df07bc42-655b-45fc-9822-f2f822e8c787 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:52.730387 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-df07bc42-655b-45fc-9822-f2f822e8c787 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:52.730387 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-df07bc42-655b-45fc-9822-f2f822e8c787 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:52.877155 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-df07bc42-655b-45fc-9822-f2f822e8c787 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:52.884721 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-df07bc42-655b-45fc-9822-f2f822e8c787 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1511 microversion: 2.1 time: 0.171181 Oct 12 18:28:52.886791 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 237/480] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:52 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1511 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:53.169211 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-bf5e8e1f-4036-42ad-ab08-b312c58da411 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:53.169852 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-bf5e8e1f-4036-42ad-ab08-b312c58da411 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:53.176661 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bf5e8e1f-4036-42ad-ab08-b312c58da411 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:53.177270 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bf5e8e1f-4036-42ad-ab08-b312c58da411 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:53.178152 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bf5e8e1f-4036-42ad-ab08-b312c58da411 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:53.178666 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bf5e8e1f-4036-42ad-ab08-b312c58da411 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:53.236133 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c8b1d83f-988d-47ff-89b9-ab77626a02b1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:53.236802 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c8b1d83f-988d-47ff-89b9-ab77626a02b1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:53.243793 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c8b1d83f-988d-47ff-89b9-ab77626a02b1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:53.244550 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c8b1d83f-988d-47ff-89b9-ab77626a02b1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:53.245517 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c8b1d83f-988d-47ff-89b9-ab77626a02b1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:53.246128 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c8b1d83f-988d-47ff-89b9-ab77626a02b1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:53.354108 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-bf5e8e1f-4036-42ad-ab08-b312c58da411 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:53.369165 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-bf5e8e1f-4036-42ad-ab08-b312c58da411 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1724 microversion: 2.1 time: 0.203163 Oct 12 18:28:53.380273 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 244/481] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:53 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:53.421475 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c8b1d83f-988d-47ff-89b9-ab77626a02b1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:53.430515 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c8b1d83f-988d-47ff-89b9-ab77626a02b1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:53.432655 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c8b1d83f-988d-47ff-89b9-ab77626a02b1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:53.434042 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c8b1d83f-988d-47ff-89b9-ab77626a02b1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1722 microversion: 2.20 time: 0.201544 Oct 12 18:28:53.443228 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 238/482] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:28:53 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:28:53.903846 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-a80a44f6-7093-4a5c-9157-ecf03a810c89 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:53.904582 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-a80a44f6-7093-4a5c-9157-ecf03a810c89 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:53.916270 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a80a44f6-7093-4a5c-9157-ecf03a810c89 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:53.921768 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a80a44f6-7093-4a5c-9157-ecf03a810c89 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:53.921768 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a80a44f6-7093-4a5c-9157-ecf03a810c89 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:53.921768 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a80a44f6-7093-4a5c-9157-ecf03a810c89 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:54.087343 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-a80a44f6-7093-4a5c-9157-ecf03a810c89 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:54.095445 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-a80a44f6-7093-4a5c-9157-ecf03a810c89 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1511 microversion: 2.1 time: 0.196869 Oct 12 18:28:54.096015 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 245/483] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:53 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1511 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:54.395319 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1a47d9cc-a657-4d01-82ac-d2fcea51c42a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:54.402741 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1a47d9cc-a657-4d01-82ac-d2fcea51c42a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:54.413726 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1a47d9cc-a657-4d01-82ac-d2fcea51c42a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:54.414451 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1a47d9cc-a657-4d01-82ac-d2fcea51c42a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:54.415814 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1a47d9cc-a657-4d01-82ac-d2fcea51c42a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:54.416692 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1a47d9cc-a657-4d01-82ac-d2fcea51c42a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:54.453755 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-04321931-daef-4841-be40-1c2d9ef7e62b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:54.454975 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-04321931-daef-4841-be40-1c2d9ef7e62b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:54.464285 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-04321931-daef-4841-be40-1c2d9ef7e62b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:54.465185 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-04321931-daef-4841-be40-1c2d9ef7e62b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:54.466261 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-04321931-daef-4841-be40-1c2d9ef7e62b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:54.466988 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-04321931-daef-4841-be40-1c2d9ef7e62b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:54.631925 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1a47d9cc-a657-4d01-82ac-d2fcea51c42a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:54.650683 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1a47d9cc-a657-4d01-82ac-d2fcea51c42a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1724 microversion: 2.1 time: 0.262264 Oct 12 18:28:54.663985 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 239/484] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:54 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1724 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:54.703656 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-04321931-daef-4841-be40-1c2d9ef7e62b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:54.713129 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-04321931-daef-4841-be40-1c2d9ef7e62b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:54.715177 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-04321931-daef-4841-be40-1c2d9ef7e62b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:54.716306 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-04321931-daef-4841-be40-1c2d9ef7e62b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1722 microversion: 2.20 time: 0.267567 Oct 12 18:28:54.717154 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 246/485] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:28:54 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:28:55.112722 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4856efee-d2b0-47a4-8053-c00697b8f922 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:55.113572 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4856efee-d2b0-47a4-8053-c00697b8f922 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:55.120915 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4856efee-d2b0-47a4-8053-c00697b8f922 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:55.121897 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4856efee-d2b0-47a4-8053-c00697b8f922 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:55.123199 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4856efee-d2b0-47a4-8053-c00697b8f922 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:55.123840 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4856efee-d2b0-47a4-8053-c00697b8f922 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:55.280692 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4856efee-d2b0-47a4-8053-c00697b8f922 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:55.289377 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4856efee-d2b0-47a4-8053-c00697b8f922 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1511 microversion: 2.1 time: 0.180189 Oct 12 18:28:55.289955 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 240/486] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:55 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1511 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:55.671097 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-8374347f-7404-4023-905e-924a0f1b8a0c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:55.671740 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-8374347f-7404-4023-905e-924a0f1b8a0c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:55.680570 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8374347f-7404-4023-905e-924a0f1b8a0c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:55.681019 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8374347f-7404-4023-905e-924a0f1b8a0c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:55.681811 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8374347f-7404-4023-905e-924a0f1b8a0c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:55.682310 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8374347f-7404-4023-905e-924a0f1b8a0c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:55.735039 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2ff0aab2-818a-4dd4-bdbd-4dd9360481ef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:55.735648 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2ff0aab2-818a-4dd4-bdbd-4dd9360481ef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:55.746163 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2ff0aab2-818a-4dd4-bdbd-4dd9360481ef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:55.746900 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2ff0aab2-818a-4dd4-bdbd-4dd9360481ef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:55.747857 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2ff0aab2-818a-4dd4-bdbd-4dd9360481ef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:55.748482 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2ff0aab2-818a-4dd4-bdbd-4dd9360481ef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:55.886971 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-8374347f-7404-4023-905e-924a0f1b8a0c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:55.897280 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-8374347f-7404-4023-905e-924a0f1b8a0c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1724 microversion: 2.1 time: 0.229867 Oct 12 18:28:55.904575 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 247/487] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:55 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:55.948690 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2ff0aab2-818a-4dd4-bdbd-4dd9360481ef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:55.957053 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2ff0aab2-818a-4dd4-bdbd-4dd9360481ef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:55.958561 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2ff0aab2-818a-4dd4-bdbd-4dd9360481ef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:55.959707 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2ff0aab2-818a-4dd4-bdbd-4dd9360481ef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1722 microversion: 2.20 time: 0.228510 Oct 12 18:28:55.960301 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 241/488] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:28:55 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:28:56.307767 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-3f77a32e-c9e4-4026-8f37-a7b0f7950a06 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:56.308424 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-3f77a32e-c9e4-4026-8f37-a7b0f7950a06 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:56.317665 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3f77a32e-c9e4-4026-8f37-a7b0f7950a06 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:56.318109 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3f77a32e-c9e4-4026-8f37-a7b0f7950a06 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:56.319101 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3f77a32e-c9e4-4026-8f37-a7b0f7950a06 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:56.319586 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3f77a32e-c9e4-4026-8f37-a7b0f7950a06 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:56.460442 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-3f77a32e-c9e4-4026-8f37-a7b0f7950a06 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:56.469001 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-3f77a32e-c9e4-4026-8f37-a7b0f7950a06 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1517 microversion: 2.1 time: 0.164778 Oct 12 18:28:56.469740 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 248/489] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:56 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:56.915901 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c3496494-6902-4f79-9fed-17ea0eb647c6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:56.917280 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c3496494-6902-4f79-9fed-17ea0eb647c6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:56.923832 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c3496494-6902-4f79-9fed-17ea0eb647c6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:56.924424 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c3496494-6902-4f79-9fed-17ea0eb647c6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:56.925277 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c3496494-6902-4f79-9fed-17ea0eb647c6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:56.925793 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c3496494-6902-4f79-9fed-17ea0eb647c6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:56.979538 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-b1c93a94-a26d-4996-a00e-81d294474bdd tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:56.980323 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-b1c93a94-a26d-4996-a00e-81d294474bdd tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:56.987361 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b1c93a94-a26d-4996-a00e-81d294474bdd tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:56.987921 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b1c93a94-a26d-4996-a00e-81d294474bdd tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:56.989002 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b1c93a94-a26d-4996-a00e-81d294474bdd tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:56.989518 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b1c93a94-a26d-4996-a00e-81d294474bdd tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:57.121738 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c3496494-6902-4f79-9fed-17ea0eb647c6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:57.130650 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c3496494-6902-4f79-9fed-17ea0eb647c6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1724 microversion: 2.1 time: 0.218303 Oct 12 18:28:57.144757 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 242/490] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:56 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:57.215352 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-b1c93a94-a26d-4996-a00e-81d294474bdd tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:57.224221 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-b1c93a94-a26d-4996-a00e-81d294474bdd tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:57.227282 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-b1c93a94-a26d-4996-a00e-81d294474bdd tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:57.229915 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-b1c93a94-a26d-4996-a00e-81d294474bdd tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1722 microversion: 2.20 time: 0.254463 Oct 12 18:28:57.237031 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 249/491] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:28:56 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:28:58.149805 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-499c8f04-25ed-4811-b014-afe58036079e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:58.150504 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-499c8f04-25ed-4811-b014-afe58036079e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:58.157702 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-499c8f04-25ed-4811-b014-afe58036079e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:58.159779 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-499c8f04-25ed-4811-b014-afe58036079e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:58.159958 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-499c8f04-25ed-4811-b014-afe58036079e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:58.160392 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-499c8f04-25ed-4811-b014-afe58036079e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:58.252120 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-2e60c07e-2f62-40c9-b9fe-d56c63df8c93 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:58.253868 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-2e60c07e-2f62-40c9-b9fe-d56c63df8c93 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:58.261726 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2e60c07e-2f62-40c9-b9fe-d56c63df8c93 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:58.262424 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2e60c07e-2f62-40c9-b9fe-d56c63df8c93 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:58.266931 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2e60c07e-2f62-40c9-b9fe-d56c63df8c93 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:58.267366 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2e60c07e-2f62-40c9-b9fe-d56c63df8c93 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:58.345251 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-499c8f04-25ed-4811-b014-afe58036079e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:58.358317 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-499c8f04-25ed-4811-b014-afe58036079e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1724 microversion: 2.1 time: 0.212073 Oct 12 18:28:58.358908 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 243/492] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:58 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:58.430630 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-2e60c07e-2f62-40c9-b9fe-d56c63df8c93 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:58.442016 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-2e60c07e-2f62-40c9-b9fe-d56c63df8c93 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:58.443982 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-2e60c07e-2f62-40c9-b9fe-d56c63df8c93 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:58.445204 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-2e60c07e-2f62-40c9-b9fe-d56c63df8c93 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1722 microversion: 2.20 time: 0.197562 Oct 12 18:28:58.445755 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 250/493] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:28:58 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:28:59.339397 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4e0e8e8c-3794-4003-a132-df03b78a1868 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:59.342161 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4e0e8e8c-3794-4003-a132-df03b78a1868 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:59.347689 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4e0e8e8c-3794-4003-a132-df03b78a1868 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:59.348132 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4e0e8e8c-3794-4003-a132-df03b78a1868 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:59.348934 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4e0e8e8c-3794-4003-a132-df03b78a1868 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:59.349365 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4e0e8e8c-3794-4003-a132-df03b78a1868 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:59.374734 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-fafac84f-c6d6-4d54-bfe7-bb1c2db911fd tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:59.375345 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-fafac84f-c6d6-4d54-bfe7-bb1c2db911fd tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:59.382032 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fafac84f-c6d6-4d54-bfe7-bb1c2db911fd tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:59.382352 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fafac84f-c6d6-4d54-bfe7-bb1c2db911fd tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:59.383096 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fafac84f-c6d6-4d54-bfe7-bb1c2db911fd tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:59.383695 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fafac84f-c6d6-4d54-bfe7-bb1c2db911fd tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:59.511686 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4e0e8e8c-3794-4003-a132-df03b78a1868 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:59.522037 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4e0e8e8c-3794-4003-a132-df03b78a1868 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1517 microversion: 2.1 time: 0.185948 Oct 12 18:28:59.522768 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 244/494] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:59 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1517 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:28:59.531360 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-db24cd1f-2dbd-4dc3-a4a6-cb610426eb4f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:28:59.532308 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-db24cd1f-2dbd-4dc3-a4a6-cb610426eb4f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:59.538728 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-db24cd1f-2dbd-4dc3-a4a6-cb610426eb4f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:59.539525 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-db24cd1f-2dbd-4dc3-a4a6-cb610426eb4f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:59.540792 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-db24cd1f-2dbd-4dc3-a4a6-cb610426eb4f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:59.541416 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-db24cd1f-2dbd-4dc3-a4a6-cb610426eb4f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:59.579573 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-fafac84f-c6d6-4d54-bfe7-bb1c2db911fd tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:59.590945 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-fafac84f-c6d6-4d54-bfe7-bb1c2db911fd tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1724 microversion: 2.1 time: 0.219574 Oct 12 18:28:59.591520 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 251/495] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:28:59 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:28:59.600386 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-531a6e21-0f58-49e1-8f02-d3c4d3223b06 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5731d78-ed20-43fb-8946-44d58a6d0c98"}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:28:59.601790 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-531a6e21-0f58-49e1-8f02-d3c4d3223b06 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:28:59.607874 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-531a6e21-0f58-49e1-8f02-d3c4d3223b06 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:59.608316 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-531a6e21-0f58-49e1-8f02-d3c4d3223b06 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:59.609118 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-531a6e21-0f58-49e1-8f02-d3c4d3223b06 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:28:59.609601 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-531a6e21-0f58-49e1-8f02-d3c4d3223b06 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:28:59.724332 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-db24cd1f-2dbd-4dc3-a4a6-cb610426eb4f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:59.740261 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-db24cd1f-2dbd-4dc3-a4a6-cb610426eb4f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:59.742268 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-db24cd1f-2dbd-4dc3-a4a6-cb610426eb4f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:28:59.743876 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-db24cd1f-2dbd-4dc3-a4a6-cb610426eb4f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1722 microversion: 2.20 time: 0.219791 Oct 12 18:28:59.744821 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 245/496] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:28:59 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:29:00.466541 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-531a6e21-0f58-49e1-8f02-d3c4d3223b06 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "POST /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.873632 Oct 12 18:29:00.480886 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 252/497] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Oct 12 18:28:59 2021] POST /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192/os-volume_attachments => generated 194 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:29:00.608752 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d08e8ad6-c739-4367-bac8-5c385167dd0b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:00.609308 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d08e8ad6-c739-4367-bac8-5c385167dd0b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:00.628574 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d08e8ad6-c739-4367-bac8-5c385167dd0b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:00.635520 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d08e8ad6-c739-4367-bac8-5c385167dd0b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:00.636591 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d08e8ad6-c739-4367-bac8-5c385167dd0b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:00.637053 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d08e8ad6-c739-4367-bac8-5c385167dd0b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:00.763571 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-fb1bdbd0-aefd-465a-9d0e-c1ec778cb43f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:00.764258 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-fb1bdbd0-aefd-465a-9d0e-c1ec778cb43f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:00.771253 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fb1bdbd0-aefd-465a-9d0e-c1ec778cb43f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:00.771965 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fb1bdbd0-aefd-465a-9d0e-c1ec778cb43f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:00.772859 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fb1bdbd0-aefd-465a-9d0e-c1ec778cb43f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:00.773289 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fb1bdbd0-aefd-465a-9d0e-c1ec778cb43f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:00.788628 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d08e8ad6-c739-4367-bac8-5c385167dd0b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:00.796708 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d08e8ad6-c739-4367-bac8-5c385167dd0b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1724 microversion: 2.1 time: 0.192560 Oct 12 18:29:00.810606 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 246/498] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:00 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:00.901803 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-fb1bdbd0-aefd-465a-9d0e-c1ec778cb43f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:00.909619 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-fb1bdbd0-aefd-465a-9d0e-c1ec778cb43f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:00.911197 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-fb1bdbd0-aefd-465a-9d0e-c1ec778cb43f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:00.912327 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-fb1bdbd0-aefd-465a-9d0e-c1ec778cb43f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1722 microversion: 2.20 time: 0.153011 Oct 12 18:29:00.912900 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 253/499] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:00 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:29:01.830743 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3dc6c66a-71cc-4a3a-8bcc-591a47d46bc2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:01.831624 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3dc6c66a-71cc-4a3a-8bcc-591a47d46bc2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:01.841237 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3dc6c66a-71cc-4a3a-8bcc-591a47d46bc2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:01.841870 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3dc6c66a-71cc-4a3a-8bcc-591a47d46bc2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:01.844123 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3dc6c66a-71cc-4a3a-8bcc-591a47d46bc2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:01.844708 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3dc6c66a-71cc-4a3a-8bcc-591a47d46bc2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:01.943469 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-44d6576e-aa93-4845-87db-bc3cc4eaa2ef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:01.946378 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-44d6576e-aa93-4845-87db-bc3cc4eaa2ef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:01.957100 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-44d6576e-aa93-4845-87db-bc3cc4eaa2ef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:01.957901 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-44d6576e-aa93-4845-87db-bc3cc4eaa2ef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:01.958918 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-44d6576e-aa93-4845-87db-bc3cc4eaa2ef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:01.959684 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-44d6576e-aa93-4845-87db-bc3cc4eaa2ef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:02.046366 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3dc6c66a-71cc-4a3a-8bcc-591a47d46bc2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:02.057255 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3dc6c66a-71cc-4a3a-8bcc-591a47d46bc2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1724 microversion: 2.1 time: 0.234688 Oct 12 18:29:02.074293 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 247/500] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:01 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:02.128060 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-44d6576e-aa93-4845-87db-bc3cc4eaa2ef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:02.137122 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-44d6576e-aa93-4845-87db-bc3cc4eaa2ef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:02.139537 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-44d6576e-aa93-4845-87db-bc3cc4eaa2ef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:02.141082 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-44d6576e-aa93-4845-87db-bc3cc4eaa2ef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1722 microversion: 2.20 time: 0.207638 Oct 12 18:29:02.142257 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 254/501] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:01 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:29:02.361219 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 18:29:02.362267 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: Tue Oct 12 18:29:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 12 18:29:02.379349 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d02bff63-0217-4b4a-88f2-be21697fa9ac tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-35951114", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-800000789", "security_groups": [{"name": "tempest-secgroup-smoke-1773849625"}], "block_device_mapping_v2": [{"uuid": "776af31a-a23a-4141-b64b-fdc3070d18fd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "61bc6454-3943-4ea7-a052-57599eadac06"}]}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:29:02.508771 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-06182c91-04c3-4f96-a447-4f23b4934bf4 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2007589833", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1852199283", "security_groups": [{"name": "tempest-secgroup-smoke-821402163"}], "networks": [{"uuid": "e167e43c-8958-46db-953d-f60c625ee80b"}], "block_device_mapping_v2": [{"uuid": "593f5bae-bf56-4a5c-b987-1cd34de571c1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:29:02.533341 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.network.neutron [None req-d02bff63-0217-4b4a-88f2-be21697fa9ac tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] validate_networks() for [('61bc6454-3943-4ea7-a052-57599eadac06', None, None, None, None, None)] {{(pid=109168) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 18:29:02.730362 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.network.neutron [None req-06182c91-04c3-4f96-a447-4f23b4934bf4 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] validate_networks() for [('e167e43c-8958-46db-953d-f60c625ee80b', None, None, None, None, None)] {{(pid=109169) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 18:29:03.215300 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-d02bff63-0217-4b4a-88f2-be21697fa9ac tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Flavor limits 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 18:29:03.216690 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-d02bff63-0217-4b4a-88f2-be21697fa9ac tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Image limits 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 18:29:03.217356 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-d02bff63-0217-4b4a-88f2-be21697fa9ac tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Flavor pref 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 18:29:03.218093 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-d02bff63-0217-4b4a-88f2-be21697fa9ac tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Image pref 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 18:29:03.218866 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-d02bff63-0217-4b4a-88f2-be21697fa9ac tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 18:29:03.227873 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d02bff63-0217-4b4a-88f2-be21697fa9ac tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:03.228753 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d02bff63-0217-4b4a-88f2-be21697fa9ac tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:03.229726 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d02bff63-0217-4b4a-88f2-be21697fa9ac tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:03.230319 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d02bff63-0217-4b4a-88f2-be21697fa9ac tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:03.250632 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-d02bff63-0217-4b4a-88f2-be21697fa9ac tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Getting quotas for project d1b808c36ccd4256858530aedc0a6f64. Resources: {'instances', 'cores', 'ram'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:29:03.257740 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-d02bff63-0217-4b4a-88f2-be21697fa9ac tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Getting quotas for user 9a37985dd5034ceeabfa47797efba5a1 and project d1b808c36ccd4256858530aedc0a6f64. Resources: {'instances', 'cores', 'ram'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:29:03.333463 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d02bff63-0217-4b4a-88f2-be21697fa9ac tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Going to run 1 instances... {{(pid=109168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 18:29:03.335671 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d02bff63-0217-4b4a-88f2-be21697fa9ac tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='776af31a-a23a-4141-b64b-fdc3070d18fd',volume_size=None,volume_type=None)] {{(pid=109168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 18:29:03.345040 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-06182c91-04c3-4f96-a447-4f23b4934bf4 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Flavor limits 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 18:29:03.346397 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-06182c91-04c3-4f96-a447-4f23b4934bf4 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Image limits 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 18:29:03.347058 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-06182c91-04c3-4f96-a447-4f23b4934bf4 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Flavor pref 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 18:29:03.347658 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-06182c91-04c3-4f96-a447-4f23b4934bf4 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Image pref 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 18:29:03.348081 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-06182c91-04c3-4f96-a447-4f23b4934bf4 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 18:29:03.360607 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-06182c91-04c3-4f96-a447-4f23b4934bf4 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:03.361259 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-06182c91-04c3-4f96-a447-4f23b4934bf4 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:03.362275 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-06182c91-04c3-4f96-a447-4f23b4934bf4 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:03.362707 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-06182c91-04c3-4f96-a447-4f23b4934bf4 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:03.389232 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.quota [None req-06182c91-04c3-4f96-a447-4f23b4934bf4 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Getting quotas for project 38a1ca7b8f55456eb3c6946099885e5e. Resources: {'instances', 'cores', 'ram'} {{(pid=109169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:29:03.394481 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.quota [None req-06182c91-04c3-4f96-a447-4f23b4934bf4 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Getting quotas for user d6959ea6a5c642258bc40a8fe0c2b3ce and project 38a1ca7b8f55456eb3c6946099885e5e. Resources: {'instances', 'cores', 'ram'} {{(pid=109169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:29:03.464369 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-06182c91-04c3-4f96-a447-4f23b4934bf4 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Going to run 1 instances... {{(pid=109169) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 18:29:03.467739 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-06182c91-04c3-4f96-a447-4f23b4934bf4 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='593f5bae-bf56-4a5c-b987-1cd34de571c1',volume_size=None,volume_type=None)] {{(pid=109169) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 18:29:03.835963 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d02bff63-0217-4b4a-88f2-be21697fa9ac tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.460415 Oct 12 18:29:03.836890 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 248/502] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Oct 12 18:29:02 2021] POST /compute/v2.1/servers => generated 406 bytes in 1462 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 18:29:03.841711 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4417c881-84ba-4286-9b45-e0c97b0a513b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:03.842504 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4417c881-84ba-4286-9b45-e0c97b0a513b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:03.849201 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4417c881-84ba-4286-9b45-e0c97b0a513b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:03.851886 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4417c881-84ba-4286-9b45-e0c97b0a513b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:03.852788 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4417c881-84ba-4286-9b45-e0c97b0a513b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:03.853329 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4417c881-84ba-4286-9b45-e0c97b0a513b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:04.013254 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4417c881-84ba-4286-9b45-e0c97b0a513b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:04.022398 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4417c881-84ba-4286-9b45-e0c97b0a513b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1701 microversion: 2.1 time: 0.184288 Oct 12 18:29:04.023002 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 249/503] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:03 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1701 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:04.027648 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d1651905-dc7a-4c6d-8246-6eb4896cabc6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:04.028256 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d1651905-dc7a-4c6d-8246-6eb4896cabc6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:04.037202 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d1651905-dc7a-4c6d-8246-6eb4896cabc6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:04.037202 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d1651905-dc7a-4c6d-8246-6eb4896cabc6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:04.037202 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d1651905-dc7a-4c6d-8246-6eb4896cabc6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:04.037202 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d1651905-dc7a-4c6d-8246-6eb4896cabc6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:04.076030 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-06182c91-04c3-4f96-a447-4f23b4934bf4 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.572730 Oct 12 18:29:04.078140 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 255/504] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Oct 12 18:29:02 2021] POST /compute/v2.1/servers => generated 405 bytes in 1576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 18:29:04.083022 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-14ebe8ab-5459-4861-89da-5e913d2610c1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:04.083968 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-14ebe8ab-5459-4861-89da-5e913d2610c1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:04.140629 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-14ebe8ab-5459-4861-89da-5e913d2610c1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:04.148311 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-14ebe8ab-5459-4861-89da-5e913d2610c1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1092 microversion: 2.1 time: 0.070497 Oct 12 18:29:04.149125 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 256/505] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:04 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1092 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:04.161666 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-b4f8ec4f-4c28-4d83-81b3-34e31f5dccb5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:29:04.172209 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b4f8ec4f-4c28-4d83-81b3-34e31f5dccb5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:04.172209 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b4f8ec4f-4c28-4d83-81b3-34e31f5dccb5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:04.215311 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d1651905-dc7a-4c6d-8246-6eb4896cabc6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:04.242592 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d1651905-dc7a-4c6d-8246-6eb4896cabc6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:04.249232 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d1651905-dc7a-4c6d-8246-6eb4896cabc6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:04.250952 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d1651905-dc7a-4c6d-8246-6eb4896cabc6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1722 microversion: 2.20 time: 0.226762 Oct 12 18:29:04.252794 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 250/506] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:04 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:29:04.253590 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-b4f8ec4f-4c28-4d83-81b3-34e31f5dccb5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Going to try to start instance {{(pid=109169) start /opt/stack/nova/nova/compute/api.py:2675}} Oct 12 18:29:04.261007 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-12ebfe7a-7f13-40ff-9e6d-8d81ff8fb24b tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:04.262987 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-12ebfe7a-7f13-40ff-9e6d-8d81ff8fb24b tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:04.341063 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-12ebfe7a-7f13-40ff-9e6d-8d81ff8fb24b tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:04.348543 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-12ebfe7a-7f13-40ff-9e6d-8d81ff8fb24b tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1089 microversion: 2.1 time: 0.093970 Oct 12 18:29:04.349199 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 251/507] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:04 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1089 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:04.541738 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-b4f8ec4f-4c28-4d83-81b3-34e31f5dccb5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 202 len: 0 microversion: 2.1 time: 0.382600 Oct 12 18:29:04.541738 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 257/508] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:29:04 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:29:04.547806 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8c576462-f65e-4713-a480-c865e686a409 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:04.548442 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8c576462-f65e-4713-a480-c865e686a409 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:04.555546 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8c576462-f65e-4713-a480-c865e686a409 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:04.556065 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8c576462-f65e-4713-a480-c865e686a409 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:04.556964 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8c576462-f65e-4713-a480-c865e686a409 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:04.557480 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8c576462-f65e-4713-a480-c865e686a409 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:04.715778 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8c576462-f65e-4713-a480-c865e686a409 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:04.723720 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8c576462-f65e-4713-a480-c865e686a409 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1710 microversion: 2.1 time: 0.179530 Oct 12 18:29:04.724292 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 252/509] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:04 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1710 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:05.167064 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-0663119d-b02c-4e2d-9524-c0dfb64b75ca tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:05.168155 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-0663119d-b02c-4e2d-9524-c0dfb64b75ca tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:05.223207 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-0663119d-b02c-4e2d-9524-c0dfb64b75ca tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:05.235989 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-0663119d-b02c-4e2d-9524-c0dfb64b75ca tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1092 microversion: 2.1 time: 0.073224 Oct 12 18:29:05.246277 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 258/510] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:05 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1092 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:05.279333 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4ba5a60b-948c-42bd-8ec9-dbd1f1b85d58 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:05.279942 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4ba5a60b-948c-42bd-8ec9-dbd1f1b85d58 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:05.286918 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4ba5a60b-948c-42bd-8ec9-dbd1f1b85d58 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:05.287825 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4ba5a60b-948c-42bd-8ec9-dbd1f1b85d58 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:05.289473 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4ba5a60b-948c-42bd-8ec9-dbd1f1b85d58 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:05.290476 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4ba5a60b-948c-42bd-8ec9-dbd1f1b85d58 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:05.366289 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-d47c977b-f705-4fd4-9501-7dd2f52ec597 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:05.367009 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-d47c977b-f705-4fd4-9501-7dd2f52ec597 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:05.433710 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-d47c977b-f705-4fd4-9501-7dd2f52ec597 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:05.444177 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-d47c977b-f705-4fd4-9501-7dd2f52ec597 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1089 microversion: 2.1 time: 0.081188 Oct 12 18:29:05.445483 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 259/511] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:05 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1089 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:29:05.451506 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4ba5a60b-948c-42bd-8ec9-dbd1f1b85d58 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:05.460110 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4ba5a60b-948c-42bd-8ec9-dbd1f1b85d58 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:05.461722 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4ba5a60b-948c-42bd-8ec9-dbd1f1b85d58 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:05.462856 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4ba5a60b-948c-42bd-8ec9-dbd1f1b85d58 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1722 microversion: 2.20 time: 0.187708 Oct 12 18:29:05.463409 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 253/512] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:05 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:29:05.741282 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-4316378b-3170-4b14-9755-f53ca2080ab4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:05.741826 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-4316378b-3170-4b14-9755-f53ca2080ab4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:05.748032 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4316378b-3170-4b14-9755-f53ca2080ab4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:05.748504 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4316378b-3170-4b14-9755-f53ca2080ab4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:05.749313 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4316378b-3170-4b14-9755-f53ca2080ab4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:05.749745 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4316378b-3170-4b14-9755-f53ca2080ab4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:05.882998 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-4316378b-3170-4b14-9755-f53ca2080ab4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:05.891553 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-4316378b-3170-4b14-9755-f53ca2080ab4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1710 microversion: 2.1 time: 0.154007 Oct 12 18:29:05.892138 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 260/513] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:05 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1710 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:06.255399 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-961de4fb-4dd6-4df5-b2ab-c56e8d9c726d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:06.255918 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-961de4fb-4dd6-4df5-b2ab-c56e8d9c726d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:06.262005 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-961de4fb-4dd6-4df5-b2ab-c56e8d9c726d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:06.262507 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-961de4fb-4dd6-4df5-b2ab-c56e8d9c726d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:06.263308 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-961de4fb-4dd6-4df5-b2ab-c56e8d9c726d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:06.263741 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-961de4fb-4dd6-4df5-b2ab-c56e8d9c726d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:06.325400 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-961de4fb-4dd6-4df5-b2ab-c56e8d9c726d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:06.334240 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-961de4fb-4dd6-4df5-b2ab-c56e8d9c726d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1190 microversion: 2.1 time: 0.084084 Oct 12 18:29:06.340939 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 254/514] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:06 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1190 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:06.462092 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-593faeb9-b8d7-43c3-a3b8-5565559f7801 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:06.462704 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-593faeb9-b8d7-43c3-a3b8-5565559f7801 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:06.468658 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-593faeb9-b8d7-43c3-a3b8-5565559f7801 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:06.469105 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-593faeb9-b8d7-43c3-a3b8-5565559f7801 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:06.469884 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-593faeb9-b8d7-43c3-a3b8-5565559f7801 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:06.470429 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-593faeb9-b8d7-43c3-a3b8-5565559f7801 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:06.480909 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ea9abefa-607b-4c7f-8ba5-5a8740f62b1c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:06.481563 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ea9abefa-607b-4c7f-8ba5-5a8740f62b1c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:06.487957 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ea9abefa-607b-4c7f-8ba5-5a8740f62b1c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:06.488731 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ea9abefa-607b-4c7f-8ba5-5a8740f62b1c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:06.489522 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ea9abefa-607b-4c7f-8ba5-5a8740f62b1c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:06.489958 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ea9abefa-607b-4c7f-8ba5-5a8740f62b1c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:06.541136 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-593faeb9-b8d7-43c3-a3b8-5565559f7801 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:06.549716 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-593faeb9-b8d7-43c3-a3b8-5565559f7801 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1131 microversion: 2.1 time: 0.091243 Oct 12 18:29:06.550306 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 261/515] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:06 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1131 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:06.656157 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ea9abefa-607b-4c7f-8ba5-5a8740f62b1c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:06.661249 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ea9abefa-607b-4c7f-8ba5-5a8740f62b1c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:06.662763 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ea9abefa-607b-4c7f-8ba5-5a8740f62b1c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:06.663933 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ea9abefa-607b-4c7f-8ba5-5a8740f62b1c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1743 microversion: 2.20 time: 0.186853 Oct 12 18:29:06.664826 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 255/516] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:06 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1743 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:29:06.913867 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-cb7e3eb4-af4f-4faf-9cab-5af781aaceec tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:06.914616 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-cb7e3eb4-af4f-4faf-9cab-5af781aaceec tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:06.921380 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cb7e3eb4-af4f-4faf-9cab-5af781aaceec tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:06.921824 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cb7e3eb4-af4f-4faf-9cab-5af781aaceec tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:06.922712 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cb7e3eb4-af4f-4faf-9cab-5af781aaceec tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:06.923141 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cb7e3eb4-af4f-4faf-9cab-5af781aaceec tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:07.062475 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-cb7e3eb4-af4f-4faf-9cab-5af781aaceec tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:07.074199 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-cb7e3eb4-af4f-4faf-9cab-5af781aaceec tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1714 microversion: 2.1 time: 0.167231 Oct 12 18:29:07.074798 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 262/517] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:06 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1714 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:07.351935 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5d975f17-9e3f-49db-9110-6769bdd73241 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:07.352579 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5d975f17-9e3f-49db-9110-6769bdd73241 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:07.359268 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5d975f17-9e3f-49db-9110-6769bdd73241 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:07.359702 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5d975f17-9e3f-49db-9110-6769bdd73241 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:07.360560 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5d975f17-9e3f-49db-9110-6769bdd73241 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:07.360994 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5d975f17-9e3f-49db-9110-6769bdd73241 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:07.428625 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5d975f17-9e3f-49db-9110-6769bdd73241 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:07.436159 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5d975f17-9e3f-49db-9110-6769bdd73241 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1208 microversion: 2.1 time: 0.088859 Oct 12 18:29:07.437167 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 256/518] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:07 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1208 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:07.568229 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-79aa24cd-6731-4d4f-a967-bf308f01568e tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:07.569290 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-79aa24cd-6731-4d4f-a967-bf308f01568e tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:07.575942 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-79aa24cd-6731-4d4f-a967-bf308f01568e tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:07.578097 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-79aa24cd-6731-4d4f-a967-bf308f01568e tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:07.578097 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-79aa24cd-6731-4d4f-a967-bf308f01568e tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:07.578097 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-79aa24cd-6731-4d4f-a967-bf308f01568e tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:07.637989 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-79aa24cd-6731-4d4f-a967-bf308f01568e tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:07.646890 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-79aa24cd-6731-4d4f-a967-bf308f01568e tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1187 microversion: 2.1 time: 0.083369 Oct 12 18:29:07.656674 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 263/519] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:07 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1187 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:07.687538 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-86678e46-115d-4682-8e57-ee9e5d2d8472 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:07.688567 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-86678e46-115d-4682-8e57-ee9e5d2d8472 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:07.696014 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-86678e46-115d-4682-8e57-ee9e5d2d8472 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:07.697127 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-86678e46-115d-4682-8e57-ee9e5d2d8472 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:07.698741 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-86678e46-115d-4682-8e57-ee9e5d2d8472 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:07.699343 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-86678e46-115d-4682-8e57-ee9e5d2d8472 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:07.872543 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-86678e46-115d-4682-8e57-ee9e5d2d8472 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:07.883100 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-86678e46-115d-4682-8e57-ee9e5d2d8472 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:07.884790 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-86678e46-115d-4682-8e57-ee9e5d2d8472 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:07.885995 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-86678e46-115d-4682-8e57-ee9e5d2d8472 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1743 microversion: 2.20 time: 0.202919 Oct 12 18:29:07.886574 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 257/520] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:07 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1743 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:29:08.460360 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-6bb886aa-c904-4d89-808f-c530aa1f929b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:08.463237 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-6bb886aa-c904-4d89-808f-c530aa1f929b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:08.473888 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6bb886aa-c904-4d89-808f-c530aa1f929b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:08.474339 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6bb886aa-c904-4d89-808f-c530aa1f929b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:08.475174 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6bb886aa-c904-4d89-808f-c530aa1f929b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:08.475770 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6bb886aa-c904-4d89-808f-c530aa1f929b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:08.627470 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-6bb886aa-c904-4d89-808f-c530aa1f929b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:08.643254 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-6bb886aa-c904-4d89-808f-c530aa1f929b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1276 microversion: 2.1 time: 0.187063 Oct 12 18:29:08.644589 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 264/521] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:08 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1276 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:08.664048 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2d8b61df-1a0d-4e9b-8ec7-8543603cf739 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:08.665344 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2d8b61df-1a0d-4e9b-8ec7-8543603cf739 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:08.672024 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2d8b61df-1a0d-4e9b-8ec7-8543603cf739 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:08.672621 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2d8b61df-1a0d-4e9b-8ec7-8543603cf739 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:08.673417 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2d8b61df-1a0d-4e9b-8ec7-8543603cf739 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:08.673847 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2d8b61df-1a0d-4e9b-8ec7-8543603cf739 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:08.771739 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2d8b61df-1a0d-4e9b-8ec7-8543603cf739 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:08.781903 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2d8b61df-1a0d-4e9b-8ec7-8543603cf739 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1205 microversion: 2.1 time: 0.121098 Oct 12 18:29:08.784237 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 258/522] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:08 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1205 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:08.904919 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-f05ccf2d-d495-49fb-ba32-211717d65846 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:08.906437 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-f05ccf2d-d495-49fb-ba32-211717d65846 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:08.913121 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f05ccf2d-d495-49fb-ba32-211717d65846 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:08.913563 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f05ccf2d-d495-49fb-ba32-211717d65846 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:08.914325 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f05ccf2d-d495-49fb-ba32-211717d65846 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:08.914943 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f05ccf2d-d495-49fb-ba32-211717d65846 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:09.118600 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3155d3bb-b090-4857-8455-858a7e64a794 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:29:09.119986 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3155d3bb-b090-4857-8455-858a7e64a794 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:09.122373 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-f05ccf2d-d495-49fb-ba32-211717d65846 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:09.129308 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3155d3bb-b090-4857-8455-858a7e64a794 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:09.130059 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3155d3bb-b090-4857-8455-858a7e64a794 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:09.131739 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3155d3bb-b090-4857-8455-858a7e64a794 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:09.132245 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3155d3bb-b090-4857-8455-858a7e64a794 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:09.133678 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-f05ccf2d-d495-49fb-ba32-211717d65846 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:09.135387 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-f05ccf2d-d495-49fb-ba32-211717d65846 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:09.136677 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-f05ccf2d-d495-49fb-ba32-211717d65846 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1743 microversion: 2.20 time: 0.236129 Oct 12 18:29:09.138082 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 265/523] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:08 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1743 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:29:09.161791 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-3155d3bb-b090-4857-8455-858a7e64a794 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lazy-loading 'flavor' on Instance uuid 4ade368f-e898-4346-83a8-3d3eb86c8192 {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:29:09.497754 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-eb5aea5b-609c-439f-82b6-9fa4d9dfe8eb req-6ff40b93-035f-46e0-b8d0-8163210431b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff8be5be-6f8c-42e2-9cd4-10c62915f993", "tag": "e9e1d074-c7de-4406-9644-edcd2e1b0059"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:29:09.499511 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:29:09.499511 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:29:09.522782 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-eb5aea5b-609c-439f-82b6-9fa4d9dfe8eb req-6ff40b93-035f-46e0-b8d0-8163210431b7 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:09.522782 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-eb5aea5b-609c-439f-82b6-9fa4d9dfe8eb req-6ff40b93-035f-46e0-b8d0-8163210431b7 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:09.542431 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-eb5aea5b-609c-439f-82b6-9fa4d9dfe8eb req-6ff40b93-035f-46e0-b8d0-8163210431b7 service nova] Creating event network-changed:e9e1d074-c7de-4406-9644-edcd2e1b0059 for instance ff8be5be-6f8c-42e2-9cd4-10c62915f993 on hv-cinder-81322 Oct 12 18:29:09.552484 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-eb5aea5b-609c-439f-82b6-9fa4d9dfe8eb req-6ff40b93-035f-46e0-b8d0-8163210431b7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057674 Oct 12 18:29:09.558027 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 266/524] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:29:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:29:09.631344 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3155d3bb-b090-4857-8455-858a7e64a794 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "POST /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192/action" status: 200 len: 32 microversion: 2.1 time: 0.511838 Oct 12 18:29:09.631344 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 259/525] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:29:09 2021] POST /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192/action => generated 32 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 18:29:09.643938 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-47f8c7ca-a60d-4501-907e-27058a4a91da tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:09.648222 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-47f8c7ca-a60d-4501-907e-27058a4a91da tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:09.660549 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-47f8c7ca-a60d-4501-907e-27058a4a91da tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:09.661375 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-47f8c7ca-a60d-4501-907e-27058a4a91da tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:09.662588 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-47f8c7ca-a60d-4501-907e-27058a4a91da tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:09.663274 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-47f8c7ca-a60d-4501-907e-27058a4a91da tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:09.663551 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d3688b83-9d8b-4069-96c6-39dfdacbb354 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:09.664439 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d3688b83-9d8b-4069-96c6-39dfdacbb354 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:09.677060 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d3688b83-9d8b-4069-96c6-39dfdacbb354 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:09.677519 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d3688b83-9d8b-4069-96c6-39dfdacbb354 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:09.678324 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d3688b83-9d8b-4069-96c6-39dfdacbb354 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:09.678755 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d3688b83-9d8b-4069-96c6-39dfdacbb354 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:10.186211 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d3688b83-9d8b-4069-96c6-39dfdacbb354 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:10.199000 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-47f8c7ca-a60d-4501-907e-27058a4a91da tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:10.214574 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-47f8c7ca-a60d-4501-907e-27058a4a91da tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1569 microversion: 2.1 time: 0.577320 Oct 12 18:29:10.215920 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 267/526] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:09 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1569 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:10.218446 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d3688b83-9d8b-4069-96c6-39dfdacbb354 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1276 microversion: 2.1 time: 0.556711 Oct 12 18:29:10.220131 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 260/527] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:09 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1276 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:29:10.224329 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c48f13f3-c2c1-4ca6-8bb8-31affb19416d tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:10.225755 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c48f13f3-c2c1-4ca6-8bb8-31affb19416d tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:10.234222 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-12d4eaa3-c124-4324-9ec9-0f869b792149 req-a9bb0905-5cb9-404e-ab95-8b689016ee94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a13e5623-9ecd-4036-b74a-48cbb84908de", "name": "network-vif-plugged", "status": "completed", "tag": "fabaeaf5-eee4-46bf-a4bf-984ef9955b1e"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:29:10.235779 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:29:10.235779 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:29:10.239604 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c48f13f3-c2c1-4ca6-8bb8-31affb19416d tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:10.243988 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c48f13f3-c2c1-4ca6-8bb8-31affb19416d tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:10.243988 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c48f13f3-c2c1-4ca6-8bb8-31affb19416d tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:10.243988 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c48f13f3-c2c1-4ca6-8bb8-31affb19416d tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:10.253688 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-12d4eaa3-c124-4324-9ec9-0f869b792149 req-a9bb0905-5cb9-404e-ab95-8b689016ee94 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:10.255321 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-12d4eaa3-c124-4324-9ec9-0f869b792149 req-a9bb0905-5cb9-404e-ab95-8b689016ee94 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:10.272750 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-12d4eaa3-c124-4324-9ec9-0f869b792149 req-a9bb0905-5cb9-404e-ab95-8b689016ee94 service nova] Creating event network-vif-plugged:fabaeaf5-eee4-46bf-a4bf-984ef9955b1e for instance a13e5623-9ecd-4036-b74a-48cbb84908de on hv-cinder-81322 Oct 12 18:29:10.277721 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-12d4eaa3-c124-4324-9ec9-0f869b792149 req-a9bb0905-5cb9-404e-ab95-8b689016ee94 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056287 Oct 12 18:29:10.278674 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 261/528] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:29:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:29:10.283993 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-fb1b8c1f-45f2-405a-86d4-85740162b18c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:10.284778 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-fb1b8c1f-45f2-405a-86d4-85740162b18c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:10.292783 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fb1b8c1f-45f2-405a-86d4-85740162b18c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:10.292783 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fb1b8c1f-45f2-405a-86d4-85740162b18c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:10.293092 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fb1b8c1f-45f2-405a-86d4-85740162b18c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:10.293509 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fb1b8c1f-45f2-405a-86d4-85740162b18c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:10.428998 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c48f13f3-c2c1-4ca6-8bb8-31affb19416d tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:10.437812 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c48f13f3-c2c1-4ca6-8bb8-31affb19416d tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1272 microversion: 2.1 time: 0.220166 Oct 12 18:29:10.445160 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 268/529] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:10 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1272 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:10.851496 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-fb1b8c1f-45f2-405a-86d4-85740162b18c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:10.872831 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-fb1b8c1f-45f2-405a-86d4-85740162b18c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:10.880302 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-fb1b8c1f-45f2-405a-86d4-85740162b18c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:10.882788 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-fb1b8c1f-45f2-405a-86d4-85740162b18c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1743 microversion: 2.20 time: 0.602792 Oct 12 18:29:10.884762 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 262/530] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:10 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1743 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:29:11.235306 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-2be5e805-a007-4762-bae2-067c5414e18f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:11.237321 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-2be5e805-a007-4762-bae2-067c5414e18f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:11.245362 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0cb52704-6426-4e71-b152-86464c1d6d44 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:11.246027 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0cb52704-6426-4e71-b152-86464c1d6d44 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:11.255460 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2be5e805-a007-4762-bae2-067c5414e18f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:11.255929 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2be5e805-a007-4762-bae2-067c5414e18f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:11.257008 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2be5e805-a007-4762-bae2-067c5414e18f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:11.257383 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0cb52704-6426-4e71-b152-86464c1d6d44 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:11.257612 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2be5e805-a007-4762-bae2-067c5414e18f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:11.258117 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0cb52704-6426-4e71-b152-86464c1d6d44 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:11.259400 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0cb52704-6426-4e71-b152-86464c1d6d44 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:11.260118 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0cb52704-6426-4e71-b152-86464c1d6d44 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:11.536818 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0cb52704-6426-4e71-b152-86464c1d6d44 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:11.550613 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-2be5e805-a007-4762-bae2-067c5414e18f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:11.553870 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0cb52704-6426-4e71-b152-86464c1d6d44 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1569 microversion: 2.1 time: 0.305588 Oct 12 18:29:11.558087 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-2be5e805-a007-4762-bae2-067c5414e18f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1264 microversion: 2.1 time: 0.326677 Oct 12 18:29:11.558661 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 269/531] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:11 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1264 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:11.559484 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 263/532] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:11 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1569 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:11.564375 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-d11659cd-a248-4def-83d5-f2a65145bc05 req-3f1f25b8-b2e4-48c8-bb03-422e044cfaf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f0cf04d-323c-4749-b9ae-d35333eb565c", "tag": "ee9e0115-2251-43e7-8da4-8dd846258e7b"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:29:11.565995 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:29:11.565995 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:29:11.573785 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-d11659cd-a248-4def-83d5-f2a65145bc05 req-3f1f25b8-b2e4-48c8-bb03-422e044cfaf3 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:11.574575 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-d11659cd-a248-4def-83d5-f2a65145bc05 req-3f1f25b8-b2e4-48c8-bb03-422e044cfaf3 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:11.586070 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-9e2851a6-badd-4caa-9221-4157633735e4 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:11.587978 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-9e2851a6-badd-4caa-9221-4157633735e4 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:11.600180 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9e2851a6-badd-4caa-9221-4157633735e4 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:11.600668 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9e2851a6-badd-4caa-9221-4157633735e4 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:11.601647 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9e2851a6-badd-4caa-9221-4157633735e4 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:11.602216 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9e2851a6-badd-4caa-9221-4157633735e4 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:11.602984 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-d11659cd-a248-4def-83d5-f2a65145bc05 req-3f1f25b8-b2e4-48c8-bb03-422e044cfaf3 service nova] Creating event network-changed:ee9e0115-2251-43e7-8da4-8dd846258e7b for instance 1f0cf04d-323c-4749-b9ae-d35333eb565c on hv-cinder-81322 Oct 12 18:29:11.613849 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-d11659cd-a248-4def-83d5-f2a65145bc05 req-3f1f25b8-b2e4-48c8-bb03-422e044cfaf3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052865 Oct 12 18:29:11.615084 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 264/533] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:29:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:29:11.771178 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-9e2851a6-badd-4caa-9221-4157633735e4 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:11.779236 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-9e2851a6-badd-4caa-9221-4157633735e4 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1260 microversion: 2.1 time: 0.217025 Oct 12 18:29:11.779838 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 270/534] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:11 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1260 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:11.904137 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0ad772f3-3467-4f71-a3e1-b1fb505ec009 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:11.905204 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0ad772f3-3467-4f71-a3e1-b1fb505ec009 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:11.911494 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0ad772f3-3467-4f71-a3e1-b1fb505ec009 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:11.911934 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0ad772f3-3467-4f71-a3e1-b1fb505ec009 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:11.916345 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0ad772f3-3467-4f71-a3e1-b1fb505ec009 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:11.916345 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0ad772f3-3467-4f71-a3e1-b1fb505ec009 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:12.065736 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0ad772f3-3467-4f71-a3e1-b1fb505ec009 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:12.072342 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0ad772f3-3467-4f71-a3e1-b1fb505ec009 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:12.073867 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0ad772f3-3467-4f71-a3e1-b1fb505ec009 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:12.075021 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0ad772f3-3467-4f71-a3e1-b1fb505ec009 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1743 microversion: 2.20 time: 0.175248 Oct 12 18:29:12.075612 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 265/535] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:11 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1743 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:29:12.587447 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-56841bb3-ea84-4e41-8ea0-9b4ff82f3ac0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:12.588146 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-56841bb3-ea84-4e41-8ea0-9b4ff82f3ac0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:12.589197 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8ca2ba69-44de-4323-9789-bc6f9ea6ffc8 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:12.589985 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8ca2ba69-44de-4323-9789-bc6f9ea6ffc8 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:12.594619 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-56841bb3-ea84-4e41-8ea0-9b4ff82f3ac0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:12.595082 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-56841bb3-ea84-4e41-8ea0-9b4ff82f3ac0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:12.596138 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-56841bb3-ea84-4e41-8ea0-9b4ff82f3ac0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:12.596286 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8ca2ba69-44de-4323-9789-bc6f9ea6ffc8 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:12.596709 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8ca2ba69-44de-4323-9789-bc6f9ea6ffc8 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:12.597095 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-56841bb3-ea84-4e41-8ea0-9b4ff82f3ac0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:12.597935 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8ca2ba69-44de-4323-9789-bc6f9ea6ffc8 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:12.598522 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8ca2ba69-44de-4323-9789-bc6f9ea6ffc8 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:12.909529 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-56841bb3-ea84-4e41-8ea0-9b4ff82f3ac0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:12.917779 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8ca2ba69-44de-4323-9789-bc6f9ea6ffc8 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:12.919084 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-56841bb3-ea84-4e41-8ea0-9b4ff82f3ac0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1569 microversion: 2.1 time: 0.335689 Oct 12 18:29:12.930540 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 271/536] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:12 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1569 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:12.933263 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8ca2ba69-44de-4323-9789-bc6f9ea6ffc8 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1264 microversion: 2.1 time: 0.347450 Oct 12 18:29:12.933867 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 266/537] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:12 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1264 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:12.936976 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-8621dbaf-0adc-4937-b6f8-9becbf2b0ab2 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:12.938015 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-8621dbaf-0adc-4937-b6f8-9becbf2b0ab2 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:12.945717 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8621dbaf-0adc-4937-b6f8-9becbf2b0ab2 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:12.948247 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8621dbaf-0adc-4937-b6f8-9becbf2b0ab2 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:12.948247 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8621dbaf-0adc-4937-b6f8-9becbf2b0ab2 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:12.948247 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8621dbaf-0adc-4937-b6f8-9becbf2b0ab2 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:13.093171 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a469fb7d-2b95-4f6b-8459-5d3e9d012f5f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:13.093777 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a469fb7d-2b95-4f6b-8459-5d3e9d012f5f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:13.099924 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a469fb7d-2b95-4f6b-8459-5d3e9d012f5f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:13.100378 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a469fb7d-2b95-4f6b-8459-5d3e9d012f5f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:13.101240 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a469fb7d-2b95-4f6b-8459-5d3e9d012f5f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:13.101858 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a469fb7d-2b95-4f6b-8459-5d3e9d012f5f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:13.128860 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-8621dbaf-0adc-4937-b6f8-9becbf2b0ab2 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:13.137056 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-8621dbaf-0adc-4937-b6f8-9becbf2b0ab2 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1260 microversion: 2.1 time: 0.204771 Oct 12 18:29:13.140538 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 272/538] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:12 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1260 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:13.238073 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a469fb7d-2b95-4f6b-8459-5d3e9d012f5f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:13.246042 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a469fb7d-2b95-4f6b-8459-5d3e9d012f5f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:13.247527 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a469fb7d-2b95-4f6b-8459-5d3e9d012f5f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:13.248769 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a469fb7d-2b95-4f6b-8459-5d3e9d012f5f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1738 microversion: 2.20 time: 0.159297 Oct 12 18:29:13.249356 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 267/539] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:13 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:29:13.939397 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-d5c8ff4e-a092-4670-9834-cf8261993ff1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:13.940070 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-d5c8ff4e-a092-4670-9834-cf8261993ff1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:13.947583 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d5c8ff4e-a092-4670-9834-cf8261993ff1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:13.950140 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d5c8ff4e-a092-4670-9834-cf8261993ff1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:13.951278 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d5c8ff4e-a092-4670-9834-cf8261993ff1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:13.951895 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d5c8ff4e-a092-4670-9834-cf8261993ff1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:13.953710 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-69333dc3-bcfb-4386-81ef-9a61b9b29ed1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:13.954371 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-69333dc3-bcfb-4386-81ef-9a61b9b29ed1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:13.965274 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-69333dc3-bcfb-4386-81ef-9a61b9b29ed1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:13.968430 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-69333dc3-bcfb-4386-81ef-9a61b9b29ed1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:13.969303 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-69333dc3-bcfb-4386-81ef-9a61b9b29ed1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:13.974172 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-69333dc3-bcfb-4386-81ef-9a61b9b29ed1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:14.162949 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-d5c8ff4e-a092-4670-9834-cf8261993ff1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:14.171107 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-d5c8ff4e-a092-4670-9834-cf8261993ff1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1569 microversion: 2.1 time: 0.235601 Oct 12 18:29:14.182085 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 273/540] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:13 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1569 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:14.187118 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-9720ba6d-d10c-4b12-a1d4-2f158074ad47 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:14.187978 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-9720ba6d-d10c-4b12-a1d4-2f158074ad47 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:14.194630 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9720ba6d-d10c-4b12-a1d4-2f158074ad47 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:14.195302 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9720ba6d-d10c-4b12-a1d4-2f158074ad47 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:14.196631 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9720ba6d-d10c-4b12-a1d4-2f158074ad47 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:14.197237 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9720ba6d-d10c-4b12-a1d4-2f158074ad47 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:14.202610 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-69333dc3-bcfb-4386-81ef-9a61b9b29ed1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:14.210829 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-69333dc3-bcfb-4386-81ef-9a61b9b29ed1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1264 microversion: 2.1 time: 0.263169 Oct 12 18:29:14.224611 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 268/541] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:13 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1264 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:29:14.268497 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-21c22a2c-a7f1-498e-872e-e8f9ea173d25 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:14.269760 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-21c22a2c-a7f1-498e-872e-e8f9ea173d25 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:14.277536 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-21c22a2c-a7f1-498e-872e-e8f9ea173d25 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:14.278182 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-21c22a2c-a7f1-498e-872e-e8f9ea173d25 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:14.279610 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-21c22a2c-a7f1-498e-872e-e8f9ea173d25 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:14.280525 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-21c22a2c-a7f1-498e-872e-e8f9ea173d25 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:14.382341 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-9720ba6d-d10c-4b12-a1d4-2f158074ad47 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:14.391872 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-9720ba6d-d10c-4b12-a1d4-2f158074ad47 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1260 microversion: 2.1 time: 0.208178 Oct 12 18:29:14.403023 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 274/542] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:14 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1260 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:14.462663 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-21c22a2c-a7f1-498e-872e-e8f9ea173d25 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:14.474148 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-21c22a2c-a7f1-498e-872e-e8f9ea173d25 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:14.476468 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-21c22a2c-a7f1-498e-872e-e8f9ea173d25 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:14.478422 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-21c22a2c-a7f1-498e-872e-e8f9ea173d25 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1738 microversion: 2.20 time: 0.214895 Oct 12 18:29:14.479482 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 269/543] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:14 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1738 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:29:15.189359 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-d4ee5555-8cd0-411f-b198-7415408d8e17 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:15.190012 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-d4ee5555-8cd0-411f-b198-7415408d8e17 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:15.196693 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d4ee5555-8cd0-411f-b198-7415408d8e17 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:15.203782 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d4ee5555-8cd0-411f-b198-7415408d8e17 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:15.203782 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d4ee5555-8cd0-411f-b198-7415408d8e17 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:15.203782 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d4ee5555-8cd0-411f-b198-7415408d8e17 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:15.231115 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-041f2e34-f77a-4eed-bf7f-f6383461d63c tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:15.232106 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-041f2e34-f77a-4eed-bf7f-f6383461d63c tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:15.238627 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-041f2e34-f77a-4eed-bf7f-f6383461d63c tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:15.239419 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-041f2e34-f77a-4eed-bf7f-f6383461d63c tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:15.240601 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-041f2e34-f77a-4eed-bf7f-f6383461d63c tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:15.241034 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-041f2e34-f77a-4eed-bf7f-f6383461d63c tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:15.408681 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-d4ee5555-8cd0-411f-b198-7415408d8e17 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:15.420539 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-d4ee5555-8cd0-411f-b198-7415408d8e17 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1569 microversion: 2.1 time: 0.234891 Oct 12 18:29:15.422570 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 275/544] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:15 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1569 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:15.436652 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-a1dd3fdf-23f3-43b4-aaf5-525a9c7c77cb tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:15.437645 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-a1dd3fdf-23f3-43b4-aaf5-525a9c7c77cb tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:15.446377 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a1dd3fdf-23f3-43b4-aaf5-525a9c7c77cb tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:15.447197 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a1dd3fdf-23f3-43b4-aaf5-525a9c7c77cb tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:15.448247 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a1dd3fdf-23f3-43b4-aaf5-525a9c7c77cb tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:15.449787 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a1dd3fdf-23f3-43b4-aaf5-525a9c7c77cb tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:15.460990 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-041f2e34-f77a-4eed-bf7f-f6383461d63c tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:15.474591 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-041f2e34-f77a-4eed-bf7f-f6383461d63c tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1264 microversion: 2.1 time: 0.247081 Oct 12 18:29:15.484764 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 270/545] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:15 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1264 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:15.496812 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-26785e59-7ef4-4e9d-9226-9de834ed66b1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:15.497449 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-26785e59-7ef4-4e9d-9226-9de834ed66b1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:15.509530 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-26785e59-7ef4-4e9d-9226-9de834ed66b1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:15.509988 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-26785e59-7ef4-4e9d-9226-9de834ed66b1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:15.510784 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-26785e59-7ef4-4e9d-9226-9de834ed66b1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:15.511222 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-26785e59-7ef4-4e9d-9226-9de834ed66b1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:15.664473 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-a1dd3fdf-23f3-43b4-aaf5-525a9c7c77cb tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:15.677655 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-a1dd3fdf-23f3-43b4-aaf5-525a9c7c77cb tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1260 microversion: 2.1 time: 0.252848 Oct 12 18:29:15.688391 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 276/546] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:15 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1260 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:15.739543 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-26785e59-7ef4-4e9d-9226-9de834ed66b1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:15.756488 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-26785e59-7ef4-4e9d-9226-9de834ed66b1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:15.759527 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-26785e59-7ef4-4e9d-9226-9de834ed66b1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:15.764656 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-26785e59-7ef4-4e9d-9226-9de834ed66b1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1738 microversion: 2.20 time: 0.267735 Oct 12 18:29:15.765297 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 271/547] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:15 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1738 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:29:16.456996 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-be624133-311c-474e-a214-c2c5b28e5a44 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:16.456996 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-be624133-311c-474e-a214-c2c5b28e5a44 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:16.461353 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-be624133-311c-474e-a214-c2c5b28e5a44 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:16.461801 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-be624133-311c-474e-a214-c2c5b28e5a44 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:16.462609 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-be624133-311c-474e-a214-c2c5b28e5a44 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:16.463044 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-be624133-311c-474e-a214-c2c5b28e5a44 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:16.493426 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-84cdec13-d5a4-458a-9e30-8ef625bfb453 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:16.494051 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-84cdec13-d5a4-458a-9e30-8ef625bfb453 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:16.499936 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-84cdec13-d5a4-458a-9e30-8ef625bfb453 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:16.500379 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-84cdec13-d5a4-458a-9e30-8ef625bfb453 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:16.501168 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-84cdec13-d5a4-458a-9e30-8ef625bfb453 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:16.501597 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-84cdec13-d5a4-458a-9e30-8ef625bfb453 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:16.622690 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-be624133-311c-474e-a214-c2c5b28e5a44 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:16.631620 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-be624133-311c-474e-a214-c2c5b28e5a44 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1569 microversion: 2.1 time: 0.197191 Oct 12 18:29:16.632200 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 277/548] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:16 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:16.664634 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-84cdec13-d5a4-458a-9e30-8ef625bfb453 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:16.671732 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-84cdec13-d5a4-458a-9e30-8ef625bfb453 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1264 microversion: 2.1 time: 0.183965 Oct 12 18:29:16.672298 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 272/549] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:16 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:29:16.694955 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-7a2eae63-c35c-4a78-9da0-b53f16d20a3f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:16.695586 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-7a2eae63-c35c-4a78-9da0-b53f16d20a3f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:16.702439 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7a2eae63-c35c-4a78-9da0-b53f16d20a3f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:16.703094 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7a2eae63-c35c-4a78-9da0-b53f16d20a3f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:16.703643 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7a2eae63-c35c-4a78-9da0-b53f16d20a3f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:16.704070 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7a2eae63-c35c-4a78-9da0-b53f16d20a3f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:16.785794 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8abe49eb-0b1c-4997-8c01-fd37b07f4fab tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:16.786491 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8abe49eb-0b1c-4997-8c01-fd37b07f4fab tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:16.792449 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8abe49eb-0b1c-4997-8c01-fd37b07f4fab tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:16.796747 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8abe49eb-0b1c-4997-8c01-fd37b07f4fab tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:16.796747 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8abe49eb-0b1c-4997-8c01-fd37b07f4fab tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:16.796747 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8abe49eb-0b1c-4997-8c01-fd37b07f4fab tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:16.829269 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-7a2eae63-c35c-4a78-9da0-b53f16d20a3f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:16.836966 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-7a2eae63-c35c-4a78-9da0-b53f16d20a3f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1260 microversion: 2.1 time: 0.145579 Oct 12 18:29:16.837599 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 278/550] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:16 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1260 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:16.928497 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8abe49eb-0b1c-4997-8c01-fd37b07f4fab tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:16.937183 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8abe49eb-0b1c-4997-8c01-fd37b07f4fab tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:16.938563 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8abe49eb-0b1c-4997-8c01-fd37b07f4fab tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:16.939720 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8abe49eb-0b1c-4997-8c01-fd37b07f4fab tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1738 microversion: 2.20 time: 0.157901 Oct 12 18:29:16.941493 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 273/551] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:16 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:29:17.648169 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-05b363e0-8988-4268-930c-5cf5c4ab0589 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:17.648787 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-05b363e0-8988-4268-930c-5cf5c4ab0589 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:17.655645 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-05b363e0-8988-4268-930c-5cf5c4ab0589 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:17.656360 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-05b363e0-8988-4268-930c-5cf5c4ab0589 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:17.657534 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-05b363e0-8988-4268-930c-5cf5c4ab0589 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:17.658524 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-05b363e0-8988-4268-930c-5cf5c4ab0589 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:17.688900 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-038ae8c0-4854-4620-92ee-4bc658093846 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:17.689678 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-038ae8c0-4854-4620-92ee-4bc658093846 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:17.695838 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-038ae8c0-4854-4620-92ee-4bc658093846 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:17.696577 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-038ae8c0-4854-4620-92ee-4bc658093846 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:17.697700 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-038ae8c0-4854-4620-92ee-4bc658093846 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:17.698441 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-038ae8c0-4854-4620-92ee-4bc658093846 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:17.892754 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-05b363e0-8988-4268-930c-5cf5c4ab0589 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:17.902210 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-05b363e0-8988-4268-930c-5cf5c4ab0589 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1569 microversion: 2.1 time: 0.257041 Oct 12 18:29:17.903988 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-038ae8c0-4854-4620-92ee-4bc658093846 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:17.907182 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 279/552] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:17 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1569 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:17.911250 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-cec4350c-bdca-402d-9249-5d334dcfa40c tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:17.911841 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-cec4350c-bdca-402d-9249-5d334dcfa40c tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:17.923185 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cec4350c-bdca-402d-9249-5d334dcfa40c tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:17.923185 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cec4350c-bdca-402d-9249-5d334dcfa40c tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:17.923185 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cec4350c-bdca-402d-9249-5d334dcfa40c tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:17.923185 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cec4350c-bdca-402d-9249-5d334dcfa40c tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:17.935072 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-038ae8c0-4854-4620-92ee-4bc658093846 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1264 microversion: 2.1 time: 0.247173 Oct 12 18:29:17.936751 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 274/553] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:17 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1264 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:29:17.971717 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c2a9e4a0-0ebd-42d3-9d5c-b3cdf4f477aa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:17.974090 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c2a9e4a0-0ebd-42d3-9d5c-b3cdf4f477aa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:17.982316 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c2a9e4a0-0ebd-42d3-9d5c-b3cdf4f477aa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:17.982316 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c2a9e4a0-0ebd-42d3-9d5c-b3cdf4f477aa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:17.982316 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c2a9e4a0-0ebd-42d3-9d5c-b3cdf4f477aa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:17.983547 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c2a9e4a0-0ebd-42d3-9d5c-b3cdf4f477aa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:18.117022 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-cec4350c-bdca-402d-9249-5d334dcfa40c tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:18.124894 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-cec4350c-bdca-402d-9249-5d334dcfa40c tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1260 microversion: 2.1 time: 0.217263 Oct 12 18:29:18.125477 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 280/554] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:17 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1260 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:18.182980 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c2a9e4a0-0ebd-42d3-9d5c-b3cdf4f477aa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:18.192664 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c2a9e4a0-0ebd-42d3-9d5c-b3cdf4f477aa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:18.196606 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c2a9e4a0-0ebd-42d3-9d5c-b3cdf4f477aa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:18.196606 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c2a9e4a0-0ebd-42d3-9d5c-b3cdf4f477aa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1738 microversion: 2.20 time: 0.237502 Oct 12 18:29:18.212329 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 275/555] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:17 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1738 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:29:18.922647 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-8bd8da1a-b0d4-47ed-b1c7-2b6544488752 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:18.923490 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-8bd8da1a-b0d4-47ed-b1c7-2b6544488752 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:18.930819 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8bd8da1a-b0d4-47ed-b1c7-2b6544488752 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:18.931306 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8bd8da1a-b0d4-47ed-b1c7-2b6544488752 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:18.932106 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8bd8da1a-b0d4-47ed-b1c7-2b6544488752 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:18.932581 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8bd8da1a-b0d4-47ed-b1c7-2b6544488752 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:18.954970 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d7729997-b40d-4878-9dfa-6cb39e42aca0 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:18.955827 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d7729997-b40d-4878-9dfa-6cb39e42aca0 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:18.963261 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d7729997-b40d-4878-9dfa-6cb39e42aca0 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:18.963805 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d7729997-b40d-4878-9dfa-6cb39e42aca0 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:18.964981 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d7729997-b40d-4878-9dfa-6cb39e42aca0 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:18.965489 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d7729997-b40d-4878-9dfa-6cb39e42aca0 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:19.099219 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-8bd8da1a-b0d4-47ed-b1c7-2b6544488752 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:19.110400 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-8bd8da1a-b0d4-47ed-b1c7-2b6544488752 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1569 microversion: 2.1 time: 0.193971 Oct 12 18:29:19.111466 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 281/556] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:18 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1569 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:29:19.142943 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-98432df8-1434-43d0-87ed-a337a49799b3 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:19.144616 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-98432df8-1434-43d0-87ed-a337a49799b3 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:19.158181 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-98432df8-1434-43d0-87ed-a337a49799b3 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:19.159675 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-98432df8-1434-43d0-87ed-a337a49799b3 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:19.160659 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-98432df8-1434-43d0-87ed-a337a49799b3 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:19.161411 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-98432df8-1434-43d0-87ed-a337a49799b3 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:19.185144 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d7729997-b40d-4878-9dfa-6cb39e42aca0 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:19.200560 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d7729997-b40d-4878-9dfa-6cb39e42aca0 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1264 microversion: 2.1 time: 0.250539 Oct 12 18:29:19.201135 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 276/557] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:18 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1264 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:19.220183 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-46d50969-b008-4d65-825e-aca17a786b91 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:19.220183 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-46d50969-b008-4d65-825e-aca17a786b91 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:19.226592 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-46d50969-b008-4d65-825e-aca17a786b91 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:19.227065 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-46d50969-b008-4d65-825e-aca17a786b91 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:19.227857 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-46d50969-b008-4d65-825e-aca17a786b91 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:19.228283 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-46d50969-b008-4d65-825e-aca17a786b91 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:19.367908 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-98432df8-1434-43d0-87ed-a337a49799b3 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:19.375462 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-98432df8-1434-43d0-87ed-a337a49799b3 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1260 microversion: 2.1 time: 0.236236 Oct 12 18:29:19.386371 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 282/558] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:19 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1260 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:19.418536 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-46d50969-b008-4d65-825e-aca17a786b91 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:19.428511 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-46d50969-b008-4d65-825e-aca17a786b91 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:19.429995 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-46d50969-b008-4d65-825e-aca17a786b91 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:19.432834 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-46d50969-b008-4d65-825e-aca17a786b91 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1738 microversion: 2.20 time: 0.216041 Oct 12 18:29:19.433546 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 277/559] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:19 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:29:20.127219 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-ae5b2b68-b0cf-4de8-8b6e-48946dff5ed8 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:20.127834 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-ae5b2b68-b0cf-4de8-8b6e-48946dff5ed8 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:20.134813 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ae5b2b68-b0cf-4de8-8b6e-48946dff5ed8 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:20.135267 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ae5b2b68-b0cf-4de8-8b6e-48946dff5ed8 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:20.136045 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ae5b2b68-b0cf-4de8-8b6e-48946dff5ed8 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:20.136505 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ae5b2b68-b0cf-4de8-8b6e-48946dff5ed8 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:20.219302 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2d695b7a-f7ac-49bd-95bc-e3b2355338d5 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:20.220236 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2d695b7a-f7ac-49bd-95bc-e3b2355338d5 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:20.235993 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2d695b7a-f7ac-49bd-95bc-e3b2355338d5 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:20.235993 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2d695b7a-f7ac-49bd-95bc-e3b2355338d5 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:20.235993 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2d695b7a-f7ac-49bd-95bc-e3b2355338d5 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:20.235993 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2d695b7a-f7ac-49bd-95bc-e3b2355338d5 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:20.282023 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-ae5b2b68-b0cf-4de8-8b6e-48946dff5ed8 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:20.293239 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-ae5b2b68-b0cf-4de8-8b6e-48946dff5ed8 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1569 microversion: 2.1 time: 0.169673 Oct 12 18:29:20.294137 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 283/560] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:20 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:29:20.363956 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2d695b7a-f7ac-49bd-95bc-e3b2355338d5 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:20.371695 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2d695b7a-f7ac-49bd-95bc-e3b2355338d5 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1264 microversion: 2.1 time: 0.156209 Oct 12 18:29:20.372286 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 278/561] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:20 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:29:20.392139 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-ba2caae9-fa02-4d0f-bfd9-00e62e2b3520 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:20.392709 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-ba2caae9-fa02-4d0f-bfd9-00e62e2b3520 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:20.398561 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ba2caae9-fa02-4d0f-bfd9-00e62e2b3520 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:20.399005 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ba2caae9-fa02-4d0f-bfd9-00e62e2b3520 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:20.399766 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ba2caae9-fa02-4d0f-bfd9-00e62e2b3520 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:20.400195 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ba2caae9-fa02-4d0f-bfd9-00e62e2b3520 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:20.450887 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a2a529b3-fabb-448f-9fac-9bd6d5d22be9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:20.451794 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a2a529b3-fabb-448f-9fac-9bd6d5d22be9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:20.458417 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a2a529b3-fabb-448f-9fac-9bd6d5d22be9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:20.459058 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a2a529b3-fabb-448f-9fac-9bd6d5d22be9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:20.459871 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a2a529b3-fabb-448f-9fac-9bd6d5d22be9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:20.460445 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a2a529b3-fabb-448f-9fac-9bd6d5d22be9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:20.565534 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-ba2caae9-fa02-4d0f-bfd9-00e62e2b3520 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:20.574044 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-ba2caae9-fa02-4d0f-bfd9-00e62e2b3520 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1260 microversion: 2.1 time: 0.185457 Oct 12 18:29:20.574643 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 284/562] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:20 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:20.632884 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a2a529b3-fabb-448f-9fac-9bd6d5d22be9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:20.646127 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a2a529b3-fabb-448f-9fac-9bd6d5d22be9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:20.647967 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a2a529b3-fabb-448f-9fac-9bd6d5d22be9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:20.649703 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a2a529b3-fabb-448f-9fac-9bd6d5d22be9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1738 microversion: 2.20 time: 0.202567 Oct 12 18:29:20.650736 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 279/563] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:20 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:29:21.312288 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-f21abaa0-2ea3-45b0-adad-605e4bc4a46c tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:21.313034 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-f21abaa0-2ea3-45b0-adad-605e4bc4a46c tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:21.319397 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f21abaa0-2ea3-45b0-adad-605e4bc4a46c tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:21.319832 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f21abaa0-2ea3-45b0-adad-605e4bc4a46c tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:21.321270 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f21abaa0-2ea3-45b0-adad-605e4bc4a46c tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:21.322224 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f21abaa0-2ea3-45b0-adad-605e4bc4a46c tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:21.388387 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-65b9518a-e520-445f-a068-96ed5882cab9 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:21.389137 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-65b9518a-e520-445f-a068-96ed5882cab9 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:21.395634 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-65b9518a-e520-445f-a068-96ed5882cab9 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:21.396135 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-65b9518a-e520-445f-a068-96ed5882cab9 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:21.396869 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-65b9518a-e520-445f-a068-96ed5882cab9 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:21.397295 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-65b9518a-e520-445f-a068-96ed5882cab9 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:21.530516 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-f21abaa0-2ea3-45b0-adad-605e4bc4a46c tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:21.540078 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-f21abaa0-2ea3-45b0-adad-605e4bc4a46c tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1569 microversion: 2.1 time: 0.232310 Oct 12 18:29:21.551365 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 285/564] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:21 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1569 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:21.590871 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-ca50b532-5c20-4f7c-96f6-a193618bd2b7 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:21.591529 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-ca50b532-5c20-4f7c-96f6-a193618bd2b7 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:21.595351 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-65b9518a-e520-445f-a068-96ed5882cab9 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:21.599593 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ca50b532-5c20-4f7c-96f6-a193618bd2b7 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:21.600031 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ca50b532-5c20-4f7c-96f6-a193618bd2b7 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:21.600839 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ca50b532-5c20-4f7c-96f6-a193618bd2b7 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:21.601264 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ca50b532-5c20-4f7c-96f6-a193618bd2b7 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:21.609718 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-65b9518a-e520-445f-a068-96ed5882cab9 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1264 microversion: 2.1 time: 0.220543 Oct 12 18:29:21.621359 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 280/565] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:21 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1264 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:29:21.671995 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-879d8486-a266-44db-923a-21be0964aec1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:21.673022 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-879d8486-a266-44db-923a-21be0964aec1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:21.682617 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-879d8486-a266-44db-923a-21be0964aec1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:21.683377 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-879d8486-a266-44db-923a-21be0964aec1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:21.684282 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-879d8486-a266-44db-923a-21be0964aec1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:21.685023 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-879d8486-a266-44db-923a-21be0964aec1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:21.797949 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-ca50b532-5c20-4f7c-96f6-a193618bd2b7 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:21.817060 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-ca50b532-5c20-4f7c-96f6-a193618bd2b7 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1260 microversion: 2.1 time: 0.229792 Oct 12 18:29:21.818355 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 286/566] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:21 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1260 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:21.871015 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-879d8486-a266-44db-923a-21be0964aec1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:21.880686 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-879d8486-a266-44db-923a-21be0964aec1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:21.882951 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-879d8486-a266-44db-923a-21be0964aec1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:21.884521 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-879d8486-a266-44db-923a-21be0964aec1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1738 microversion: 2.20 time: 0.219105 Oct 12 18:29:21.885339 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 281/567] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:21 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:29:22.566727 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-1713b74b-390a-4625-8790-3c743a716d4b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:22.567526 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-1713b74b-390a-4625-8790-3c743a716d4b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:22.574144 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1713b74b-390a-4625-8790-3c743a716d4b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:22.580522 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1713b74b-390a-4625-8790-3c743a716d4b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:22.580522 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1713b74b-390a-4625-8790-3c743a716d4b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:22.580522 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1713b74b-390a-4625-8790-3c743a716d4b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:22.642088 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3398dad4-5d8e-439d-b38f-10dfa94c4bca tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:22.644062 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3398dad4-5d8e-439d-b38f-10dfa94c4bca tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:22.652238 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3398dad4-5d8e-439d-b38f-10dfa94c4bca tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:22.653129 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3398dad4-5d8e-439d-b38f-10dfa94c4bca tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:22.654500 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3398dad4-5d8e-439d-b38f-10dfa94c4bca tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:22.655168 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3398dad4-5d8e-439d-b38f-10dfa94c4bca tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:22.785623 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-1713b74b-390a-4625-8790-3c743a716d4b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:22.807598 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-1713b74b-390a-4625-8790-3c743a716d4b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1569 microversion: 2.1 time: 0.245976 Oct 12 18:29:22.808305 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 287/568] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:22 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1569 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:22.842455 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-b0ede24d-0582-417c-a12a-19f9cf63081f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:22.842455 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-b0ede24d-0582-417c-a12a-19f9cf63081f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:22.846747 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b0ede24d-0582-417c-a12a-19f9cf63081f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:22.851549 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b0ede24d-0582-417c-a12a-19f9cf63081f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:22.851549 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b0ede24d-0582-417c-a12a-19f9cf63081f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:22.851549 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b0ede24d-0582-417c-a12a-19f9cf63081f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:22.872751 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3398dad4-5d8e-439d-b38f-10dfa94c4bca tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:22.883132 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3398dad4-5d8e-439d-b38f-10dfa94c4bca tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1264 microversion: 2.1 time: 0.258572 Oct 12 18:29:22.893825 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 282/569] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:22 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1264 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:29:22.905843 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7768953b-6ab3-436d-bf5e-0dd4d76f0204 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:22.906767 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7768953b-6ab3-436d-bf5e-0dd4d76f0204 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:22.913256 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7768953b-6ab3-436d-bf5e-0dd4d76f0204 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:22.914057 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7768953b-6ab3-436d-bf5e-0dd4d76f0204 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:22.915150 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7768953b-6ab3-436d-bf5e-0dd4d76f0204 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:22.915797 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7768953b-6ab3-436d-bf5e-0dd4d76f0204 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:23.035757 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-b0ede24d-0582-417c-a12a-19f9cf63081f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:23.052114 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-b0ede24d-0582-417c-a12a-19f9cf63081f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1260 microversion: 2.1 time: 0.218429 Oct 12 18:29:23.055081 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 288/570] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:22 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1260 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:23.092975 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7768953b-6ab3-436d-bf5e-0dd4d76f0204 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:23.101619 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7768953b-6ab3-436d-bf5e-0dd4d76f0204 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:23.103315 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7768953b-6ab3-436d-bf5e-0dd4d76f0204 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:23.104688 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7768953b-6ab3-436d-bf5e-0dd4d76f0204 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1738 microversion: 2.20 time: 0.203125 Oct 12 18:29:23.105363 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 283/571] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:22 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:29:23.826384 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-b7d8a40c-d33b-4570-bb4f-12b71b0fac24 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:23.827011 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-b7d8a40c-d33b-4570-bb4f-12b71b0fac24 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:23.834034 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b7d8a40c-d33b-4570-bb4f-12b71b0fac24 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:23.834475 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b7d8a40c-d33b-4570-bb4f-12b71b0fac24 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:23.835317 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b7d8a40c-d33b-4570-bb4f-12b71b0fac24 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:23.835769 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b7d8a40c-d33b-4570-bb4f-12b71b0fac24 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:23.904947 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4555f1a3-7620-4a06-b20a-dd3d358565f3 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:23.906247 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4555f1a3-7620-4a06-b20a-dd3d358565f3 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:23.916551 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4555f1a3-7620-4a06-b20a-dd3d358565f3 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:23.917307 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4555f1a3-7620-4a06-b20a-dd3d358565f3 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:23.918313 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4555f1a3-7620-4a06-b20a-dd3d358565f3 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:23.918986 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4555f1a3-7620-4a06-b20a-dd3d358565f3 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:23.983313 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-b7d8a40c-d33b-4570-bb4f-12b71b0fac24 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:23.992795 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-b7d8a40c-d33b-4570-bb4f-12b71b0fac24 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1569 microversion: 2.1 time: 0.170213 Oct 12 18:29:24.001751 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 289/572] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:23 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:24.071279 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4555f1a3-7620-4a06-b20a-dd3d358565f3 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:24.072653 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-2994f71d-4ac3-4714-8b58-83bc790248fe tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:24.073302 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-2994f71d-4ac3-4714-8b58-83bc790248fe tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:24.079585 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4555f1a3-7620-4a06-b20a-dd3d358565f3 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1264 microversion: 2.1 time: 0.181750 Oct 12 18:29:24.079853 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2994f71d-4ac3-4714-8b58-83bc790248fe tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:24.081116 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2994f71d-4ac3-4714-8b58-83bc790248fe tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:24.082051 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2994f71d-4ac3-4714-8b58-83bc790248fe tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:24.082609 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2994f71d-4ac3-4714-8b58-83bc790248fe tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:24.084848 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 284/573] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:23 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1264 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:29:24.124769 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-bda7bce4-47cc-4132-b70d-e51f8079ae8b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:24.128061 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-bda7bce4-47cc-4132-b70d-e51f8079ae8b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:24.137133 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bda7bce4-47cc-4132-b70d-e51f8079ae8b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:24.137586 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bda7bce4-47cc-4132-b70d-e51f8079ae8b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:24.138380 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bda7bce4-47cc-4132-b70d-e51f8079ae8b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:24.138816 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bda7bce4-47cc-4132-b70d-e51f8079ae8b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:24.325628 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-2994f71d-4ac3-4714-8b58-83bc790248fe tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:24.336263 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-2994f71d-4ac3-4714-8b58-83bc790248fe tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1260 microversion: 2.1 time: 0.268035 Oct 12 18:29:24.337480 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 290/574] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:24 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1260 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:29:24.349367 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-53158841-5d79-4045-9be3-f4edbd9b8326 req-40d24c81-cd3c-47fd-bc9d-f24ff7e9bc68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff8be5be-6f8c-42e2-9cd4-10c62915f993", "name": "network-vif-plugged", "status": "completed", "tag": "e9e1d074-c7de-4406-9644-edcd2e1b0059"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:29:24.351588 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:29:24.351588 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:29:24.355233 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-bda7bce4-47cc-4132-b70d-e51f8079ae8b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:24.360159 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-53158841-5d79-4045-9be3-f4edbd9b8326 req-40d24c81-cd3c-47fd-bc9d-f24ff7e9bc68 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:24.361135 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-53158841-5d79-4045-9be3-f4edbd9b8326 req-40d24c81-cd3c-47fd-bc9d-f24ff7e9bc68 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:24.364076 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-bda7bce4-47cc-4132-b70d-e51f8079ae8b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:24.368943 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-bda7bce4-47cc-4132-b70d-e51f8079ae8b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:24.370328 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-bda7bce4-47cc-4132-b70d-e51f8079ae8b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1738 microversion: 2.20 time: 0.251160 Oct 12 18:29:24.371878 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 285/575] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:24 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1738 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:29:24.374137 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-53158841-5d79-4045-9be3-f4edbd9b8326 req-40d24c81-cd3c-47fd-bc9d-f24ff7e9bc68 service nova] Creating event network-vif-plugged:e9e1d074-c7de-4406-9644-edcd2e1b0059 for instance ff8be5be-6f8c-42e2-9cd4-10c62915f993 on hv-cinder-81322 Oct 12 18:29:24.386028 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-53158841-5d79-4045-9be3-f4edbd9b8326 req-40d24c81-cd3c-47fd-bc9d-f24ff7e9bc68 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045815 Oct 12 18:29:24.386028 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 291/576] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:29:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:29:25.014944 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-057dc629-c8e9-42c5-bebe-bf04bc0f1df4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:25.019194 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-057dc629-c8e9-42c5-bebe-bf04bc0f1df4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:25.021968 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-057dc629-c8e9-42c5-bebe-bf04bc0f1df4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:25.022412 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-057dc629-c8e9-42c5-bebe-bf04bc0f1df4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:25.023182 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-057dc629-c8e9-42c5-bebe-bf04bc0f1df4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:25.023612 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-057dc629-c8e9-42c5-bebe-bf04bc0f1df4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:25.100007 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-a31f1fb5-1489-40a2-adf4-bf6673cedfba tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:25.101825 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-a31f1fb5-1489-40a2-adf4-bf6673cedfba tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:25.114692 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a31f1fb5-1489-40a2-adf4-bf6673cedfba tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:25.115531 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a31f1fb5-1489-40a2-adf4-bf6673cedfba tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:25.116997 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a31f1fb5-1489-40a2-adf4-bf6673cedfba tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:25.118128 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a31f1fb5-1489-40a2-adf4-bf6673cedfba tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:25.176769 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-057dc629-c8e9-42c5-bebe-bf04bc0f1df4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:25.184860 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-057dc629-c8e9-42c5-bebe-bf04bc0f1df4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1569 microversion: 2.1 time: 0.173481 Oct 12 18:29:25.185459 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 286/577] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:25 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:25.273643 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-a31f1fb5-1489-40a2-adf4-bf6673cedfba tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:25.281175 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-a31f1fb5-1489-40a2-adf4-bf6673cedfba tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1264 microversion: 2.1 time: 0.186043 Oct 12 18:29:25.281739 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 292/578] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:25 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1264 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:25.353293 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c32424bb-e869-4538-8536-bf9ca8cb7c42 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:25.353894 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c32424bb-e869-4538-8536-bf9ca8cb7c42 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:25.359925 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c32424bb-e869-4538-8536-bf9ca8cb7c42 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:25.360381 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c32424bb-e869-4538-8536-bf9ca8cb7c42 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:25.361179 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c32424bb-e869-4538-8536-bf9ca8cb7c42 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:25.361669 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c32424bb-e869-4538-8536-bf9ca8cb7c42 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:25.390882 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-e058f8a4-033b-4e35-8e4f-38bb6091dd49 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:25.391570 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-e058f8a4-033b-4e35-8e4f-38bb6091dd49 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:25.398562 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e058f8a4-033b-4e35-8e4f-38bb6091dd49 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:25.399120 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e058f8a4-033b-4e35-8e4f-38bb6091dd49 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:25.400026 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e058f8a4-033b-4e35-8e4f-38bb6091dd49 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:25.400568 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e058f8a4-033b-4e35-8e4f-38bb6091dd49 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:25.573319 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c32424bb-e869-4538-8536-bf9ca8cb7c42 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:25.581258 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c32424bb-e869-4538-8536-bf9ca8cb7c42 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1260 microversion: 2.1 time: 0.230953 Oct 12 18:29:25.581922 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 287/579] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:25 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1260 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:29:25.594076 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-e058f8a4-033b-4e35-8e4f-38bb6091dd49 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:25.601942 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-e058f8a4-033b-4e35-8e4f-38bb6091dd49 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:25.603423 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-e058f8a4-033b-4e35-8e4f-38bb6091dd49 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:25.604592 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-e058f8a4-033b-4e35-8e4f-38bb6091dd49 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1738 microversion: 2.20 time: 0.218069 Oct 12 18:29:25.605143 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 293/580] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:25 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:29:26.201644 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-6ffba411-c038-4884-996d-4196ce5384f3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:26.202290 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-6ffba411-c038-4884-996d-4196ce5384f3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:26.208383 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6ffba411-c038-4884-996d-4196ce5384f3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:26.208853 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6ffba411-c038-4884-996d-4196ce5384f3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:26.209611 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6ffba411-c038-4884-996d-4196ce5384f3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:26.210038 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6ffba411-c038-4884-996d-4196ce5384f3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:26.298333 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-7de02c85-2815-44c7-b49e-5d31b4445070 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:26.299197 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-7de02c85-2815-44c7-b49e-5d31b4445070 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:26.306751 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7de02c85-2815-44c7-b49e-5d31b4445070 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:26.307196 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7de02c85-2815-44c7-b49e-5d31b4445070 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:26.308161 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7de02c85-2815-44c7-b49e-5d31b4445070 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:26.308648 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7de02c85-2815-44c7-b49e-5d31b4445070 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:26.395093 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-6ffba411-c038-4884-996d-4196ce5384f3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:26.404040 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-6ffba411-c038-4884-996d-4196ce5384f3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1569 microversion: 2.1 time: 0.206023 Oct 12 18:29:26.408175 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 288/581] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:26 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1569 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:26.453563 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-7de02c85-2815-44c7-b49e-5d31b4445070 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:26.462176 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-7de02c85-2815-44c7-b49e-5d31b4445070 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1264 microversion: 2.1 time: 0.167948 Oct 12 18:29:26.462743 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 294/582] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:26 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:29:26.598062 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e452b908-814d-4037-88ac-dce7d46c599c tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:26.599631 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e452b908-814d-4037-88ac-dce7d46c599c tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:26.604620 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e452b908-814d-4037-88ac-dce7d46c599c tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:26.605069 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e452b908-814d-4037-88ac-dce7d46c599c tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:26.605835 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e452b908-814d-4037-88ac-dce7d46c599c tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:26.606274 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e452b908-814d-4037-88ac-dce7d46c599c tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:26.623511 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-f41c7784-5bab-40c0-b577-31273c6f32ff tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:26.624117 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-f41c7784-5bab-40c0-b577-31273c6f32ff tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:26.630591 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f41c7784-5bab-40c0-b577-31273c6f32ff tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:26.631027 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f41c7784-5bab-40c0-b577-31273c6f32ff tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:26.631793 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f41c7784-5bab-40c0-b577-31273c6f32ff tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:26.632214 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f41c7784-5bab-40c0-b577-31273c6f32ff tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:26.816263 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e452b908-814d-4037-88ac-dce7d46c599c tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:26.818658 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-f41c7784-5bab-40c0-b577-31273c6f32ff tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:26.823854 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e452b908-814d-4037-88ac-dce7d46c599c tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1260 microversion: 2.1 time: 0.229422 Oct 12 18:29:26.824549 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 289/583] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:26 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1260 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:26.826917 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-f41c7784-5bab-40c0-b577-31273c6f32ff tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:26.828600 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-f41c7784-5bab-40c0-b577-31273c6f32ff tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:26.829798 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-f41c7784-5bab-40c0-b577-31273c6f32ff tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1738 microversion: 2.20 time: 0.210814 Oct 12 18:29:26.830346 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 295/584] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:26 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1738 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:29:27.424423 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8f0207e3-96ed-467f-8dde-0dd97ed50e61 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:27.425138 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8f0207e3-96ed-467f-8dde-0dd97ed50e61 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:27.431310 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8f0207e3-96ed-467f-8dde-0dd97ed50e61 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:27.431725 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8f0207e3-96ed-467f-8dde-0dd97ed50e61 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:27.432563 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8f0207e3-96ed-467f-8dde-0dd97ed50e61 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:27.433003 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8f0207e3-96ed-467f-8dde-0dd97ed50e61 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:27.479450 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-827d043f-d203-4576-9b8f-99153cdf4d03 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:27.480200 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-827d043f-d203-4576-9b8f-99153cdf4d03 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:27.486059 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-827d043f-d203-4576-9b8f-99153cdf4d03 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:27.486510 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-827d043f-d203-4576-9b8f-99153cdf4d03 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:27.487280 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-827d043f-d203-4576-9b8f-99153cdf4d03 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:27.487706 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-827d043f-d203-4576-9b8f-99153cdf4d03 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:27.585559 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8f0207e3-96ed-467f-8dde-0dd97ed50e61 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:27.593220 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8f0207e3-96ed-467f-8dde-0dd97ed50e61 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1569 microversion: 2.1 time: 0.172390 Oct 12 18:29:27.593784 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 290/585] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:27 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:27.635880 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-827d043f-d203-4576-9b8f-99153cdf4d03 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:27.643060 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-827d043f-d203-4576-9b8f-99153cdf4d03 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1264 microversion: 2.1 time: 0.167261 Oct 12 18:29:27.643624 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 296/586] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:27 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:27.840686 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f31f9e9d-2b42-4c20-8436-f80c76354cc5 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:27.841293 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f31f9e9d-2b42-4c20-8436-f80c76354cc5 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:27.847107 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f31f9e9d-2b42-4c20-8436-f80c76354cc5 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:27.847825 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c9286b79-b964-43be-b5e8-e0a10d77b4bd tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:27.848078 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f31f9e9d-2b42-4c20-8436-f80c76354cc5 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:27.848469 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c9286b79-b964-43be-b5e8-e0a10d77b4bd tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:27.848867 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f31f9e9d-2b42-4c20-8436-f80c76354cc5 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:27.849291 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f31f9e9d-2b42-4c20-8436-f80c76354cc5 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:27.854105 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c9286b79-b964-43be-b5e8-e0a10d77b4bd tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:27.854542 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c9286b79-b964-43be-b5e8-e0a10d77b4bd tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:27.855302 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c9286b79-b964-43be-b5e8-e0a10d77b4bd tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:27.855730 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c9286b79-b964-43be-b5e8-e0a10d77b4bd tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:28.023800 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f31f9e9d-2b42-4c20-8436-f80c76354cc5 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:28.028759 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c9286b79-b964-43be-b5e8-e0a10d77b4bd tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:28.031463 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f31f9e9d-2b42-4c20-8436-f80c76354cc5 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1260 microversion: 2.1 time: 0.194333 Oct 12 18:29:28.032034 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 291/587] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:27 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:28.036698 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c9286b79-b964-43be-b5e8-e0a10d77b4bd tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:28.038200 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c9286b79-b964-43be-b5e8-e0a10d77b4bd tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:28.039345 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c9286b79-b964-43be-b5e8-e0a10d77b4bd tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1738 microversion: 2.20 time: 0.195680 Oct 12 18:29:28.039891 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 297/588] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:27 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:29:28.610689 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a1b71ace-30f0-447b-9d2b-8220e1da2712 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:28.611302 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a1b71ace-30f0-447b-9d2b-8220e1da2712 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:28.617847 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a1b71ace-30f0-447b-9d2b-8220e1da2712 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:28.618285 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a1b71ace-30f0-447b-9d2b-8220e1da2712 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:28.619385 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a1b71ace-30f0-447b-9d2b-8220e1da2712 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:28.619492 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a1b71ace-30f0-447b-9d2b-8220e1da2712 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:28.661423 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-dbca1dc8-a9d6-4018-bc5c-6f2f39caeb47 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:28.662068 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-dbca1dc8-a9d6-4018-bc5c-6f2f39caeb47 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:28.668341 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-dbca1dc8-a9d6-4018-bc5c-6f2f39caeb47 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:28.668926 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-dbca1dc8-a9d6-4018-bc5c-6f2f39caeb47 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:28.669746 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-dbca1dc8-a9d6-4018-bc5c-6f2f39caeb47 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:28.670191 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-dbca1dc8-a9d6-4018-bc5c-6f2f39caeb47 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:28.997171 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a1b71ace-30f0-447b-9d2b-8220e1da2712 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:29.005294 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a1b71ace-30f0-447b-9d2b-8220e1da2712 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1569 microversion: 2.1 time: 0.398226 Oct 12 18:29:29.005988 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 292/589] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:28 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1569 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:29.048071 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b360ef66-be0b-4a40-910b-d443a4f5a76f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:29.048702 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b360ef66-be0b-4a40-910b-d443a4f5a76f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:29.054696 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b360ef66-be0b-4a40-910b-d443a4f5a76f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:29.055144 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b360ef66-be0b-4a40-910b-d443a4f5a76f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:29.055920 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b360ef66-be0b-4a40-910b-d443a4f5a76f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:29.056355 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b360ef66-be0b-4a40-910b-d443a4f5a76f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:29.060769 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-dbca1dc8-a9d6-4018-bc5c-6f2f39caeb47 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:29.068149 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-dbca1dc8-a9d6-4018-bc5c-6f2f39caeb47 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1264 microversion: 2.1 time: 0.411086 Oct 12 18:29:29.068832 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 298/590] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:28 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1264 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:29:29.073241 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-a726d5f2-76f8-4a61-91c8-0afef6536626 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:29.073837 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-a726d5f2-76f8-4a61-91c8-0afef6536626 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:29.079735 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a726d5f2-76f8-4a61-91c8-0afef6536626 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:29.080171 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a726d5f2-76f8-4a61-91c8-0afef6536626 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:29.080965 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a726d5f2-76f8-4a61-91c8-0afef6536626 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:29.081388 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a726d5f2-76f8-4a61-91c8-0afef6536626 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:29.240942 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b360ef66-be0b-4a40-910b-d443a4f5a76f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:29.246058 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-a726d5f2-76f8-4a61-91c8-0afef6536626 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:29.254264 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b360ef66-be0b-4a40-910b-d443a4f5a76f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1260 microversion: 2.1 time: 0.204577 Oct 12 18:29:29.254264 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 293/591] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:29 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1260 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:29:29.254552 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-a726d5f2-76f8-4a61-91c8-0afef6536626 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:29.255939 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-a726d5f2-76f8-4a61-91c8-0afef6536626 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:29.257120 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-a726d5f2-76f8-4a61-91c8-0afef6536626 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1738 microversion: 2.20 time: 0.187382 Oct 12 18:29:29.257669 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 299/592] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:29 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:29:30.022515 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-572fe674-b21d-4a36-9bdc-20c1f9c8dd01 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:30.023290 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-572fe674-b21d-4a36-9bdc-20c1f9c8dd01 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:30.029855 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-572fe674-b21d-4a36-9bdc-20c1f9c8dd01 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:30.030291 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-572fe674-b21d-4a36-9bdc-20c1f9c8dd01 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:30.031069 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-572fe674-b21d-4a36-9bdc-20c1f9c8dd01 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:30.031495 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-572fe674-b21d-4a36-9bdc-20c1f9c8dd01 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:30.085322 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-607567ea-c30f-44fe-8059-22d845e56069 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:30.086114 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-607567ea-c30f-44fe-8059-22d845e56069 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:30.092148 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-607567ea-c30f-44fe-8059-22d845e56069 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:30.092629 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-607567ea-c30f-44fe-8059-22d845e56069 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:30.093402 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-607567ea-c30f-44fe-8059-22d845e56069 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:30.093895 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-607567ea-c30f-44fe-8059-22d845e56069 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:30.179514 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-572fe674-b21d-4a36-9bdc-20c1f9c8dd01 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:30.187318 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-572fe674-b21d-4a36-9bdc-20c1f9c8dd01 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1569 microversion: 2.1 time: 0.168963 Oct 12 18:29:30.187904 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 294/593] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:30 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:30.235003 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-607567ea-c30f-44fe-8059-22d845e56069 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:30.242269 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-607567ea-c30f-44fe-8059-22d845e56069 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1264 microversion: 2.1 time: 0.160733 Oct 12 18:29:30.242920 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 300/594] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:30 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:29:30.265796 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-580b5595-bb79-4d7e-9797-401c36696ad2 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:30.266401 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-580b5595-bb79-4d7e-9797-401c36696ad2 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:30.272753 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-580b5595-bb79-4d7e-9797-401c36696ad2 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:30.273151 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-580b5595-bb79-4d7e-9797-401c36696ad2 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:30.273940 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-580b5595-bb79-4d7e-9797-401c36696ad2 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:30.274373 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-580b5595-bb79-4d7e-9797-401c36696ad2 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:30.277632 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-7facc0a9-96f9-4a52-9439-2db1bc39d238 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:30.278399 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-7facc0a9-96f9-4a52-9439-2db1bc39d238 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:30.284286 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7facc0a9-96f9-4a52-9439-2db1bc39d238 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:30.284819 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7facc0a9-96f9-4a52-9439-2db1bc39d238 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:30.286202 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7facc0a9-96f9-4a52-9439-2db1bc39d238 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:30.287188 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7facc0a9-96f9-4a52-9439-2db1bc39d238 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:30.460477 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-580b5595-bb79-4d7e-9797-401c36696ad2 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:30.475404 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-580b5595-bb79-4d7e-9797-401c36696ad2 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1260 microversion: 2.1 time: 0.213052 Oct 12 18:29:30.481969 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 295/595] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:30 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1260 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:30.491860 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-7facc0a9-96f9-4a52-9439-2db1bc39d238 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:30.499833 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-7facc0a9-96f9-4a52-9439-2db1bc39d238 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:30.501361 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-7facc0a9-96f9-4a52-9439-2db1bc39d238 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:30.502522 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-7facc0a9-96f9-4a52-9439-2db1bc39d238 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1738 microversion: 2.20 time: 0.230920 Oct 12 18:29:30.503084 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 301/596] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:30 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:29:31.203796 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-544af48b-fa4d-4247-b8ab-d47331ba5920 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:31.204450 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-544af48b-fa4d-4247-b8ab-d47331ba5920 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:31.210199 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-544af48b-fa4d-4247-b8ab-d47331ba5920 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:31.210647 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-544af48b-fa4d-4247-b8ab-d47331ba5920 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:31.211423 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-544af48b-fa4d-4247-b8ab-d47331ba5920 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:31.211863 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-544af48b-fa4d-4247-b8ab-d47331ba5920 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:31.259443 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-3415a363-1e33-42cc-a0fd-00ab827b97e3 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:31.260231 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-3415a363-1e33-42cc-a0fd-00ab827b97e3 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:31.266652 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3415a363-1e33-42cc-a0fd-00ab827b97e3 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:31.267180 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3415a363-1e33-42cc-a0fd-00ab827b97e3 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:31.268101 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3415a363-1e33-42cc-a0fd-00ab827b97e3 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:31.268672 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3415a363-1e33-42cc-a0fd-00ab827b97e3 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:31.411098 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-544af48b-fa4d-4247-b8ab-d47331ba5920 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:31.418873 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-544af48b-fa4d-4247-b8ab-d47331ba5920 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1569 microversion: 2.1 time: 0.218672 Oct 12 18:29:31.419445 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 296/597] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:31 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1569 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:31.430780 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-3415a363-1e33-42cc-a0fd-00ab827b97e3 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:31.437931 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-3415a363-1e33-42cc-a0fd-00ab827b97e3 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1264 microversion: 2.1 time: 0.182178 Oct 12 18:29:31.438481 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 302/598] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:31 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:29:31.497780 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-beacd933-3b76-42a0-bcca-f19407e9569f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:31.498390 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-beacd933-3b76-42a0-bcca-f19407e9569f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:31.504182 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-beacd933-3b76-42a0-bcca-f19407e9569f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:31.504663 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-beacd933-3b76-42a0-bcca-f19407e9569f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:31.505422 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-beacd933-3b76-42a0-bcca-f19407e9569f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:31.505852 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-beacd933-3b76-42a0-bcca-f19407e9569f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:31.520545 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-a72c3268-2f6d-48ed-8d6b-9e8b46f89f91 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:31.521295 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-a72c3268-2f6d-48ed-8d6b-9e8b46f89f91 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:31.527410 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a72c3268-2f6d-48ed-8d6b-9e8b46f89f91 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:31.527842 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a72c3268-2f6d-48ed-8d6b-9e8b46f89f91 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:31.528649 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a72c3268-2f6d-48ed-8d6b-9e8b46f89f91 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:31.529071 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a72c3268-2f6d-48ed-8d6b-9e8b46f89f91 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:31.687795 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-beacd933-3b76-42a0-bcca-f19407e9569f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:31.694815 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-a72c3268-2f6d-48ed-8d6b-9e8b46f89f91 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:31.696132 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-beacd933-3b76-42a0-bcca-f19407e9569f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1260 microversion: 2.1 time: 0.201944 Oct 12 18:29:31.696970 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 297/599] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:31 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1260 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:29:31.702822 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-a72c3268-2f6d-48ed-8d6b-9e8b46f89f91 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:31.704361 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-a72c3268-2f6d-48ed-8d6b-9e8b46f89f91 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:31.705551 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-a72c3268-2f6d-48ed-8d6b-9e8b46f89f91 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1720 microversion: 2.20 time: 0.188660 Oct 12 18:29:31.706104 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 303/600] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:31 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1720 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:29:32.438504 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-09fd780b-c465-4890-bdd7-d344f6066fc3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:32.439111 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-09fd780b-c465-4890-bdd7-d344f6066fc3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:32.445682 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-09fd780b-c465-4890-bdd7-d344f6066fc3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:32.446126 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-09fd780b-c465-4890-bdd7-d344f6066fc3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:32.446890 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-09fd780b-c465-4890-bdd7-d344f6066fc3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:32.447320 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-09fd780b-c465-4890-bdd7-d344f6066fc3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:32.454147 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-10136298-b722-4957-95b0-fdcda2eadcbb tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:32.454742 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-10136298-b722-4957-95b0-fdcda2eadcbb tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:32.461648 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-10136298-b722-4957-95b0-fdcda2eadcbb tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:32.462270 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-10136298-b722-4957-95b0-fdcda2eadcbb tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:32.463115 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-10136298-b722-4957-95b0-fdcda2eadcbb tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:32.463554 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-10136298-b722-4957-95b0-fdcda2eadcbb tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:32.632101 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-09fd780b-c465-4890-bdd7-d344f6066fc3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:32.640723 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-09fd780b-c465-4890-bdd7-d344f6066fc3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1569 microversion: 2.1 time: 0.207905 Oct 12 18:29:32.641550 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 298/601] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:32 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:32.649264 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-10136298-b722-4957-95b0-fdcda2eadcbb tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:32.656952 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-10136298-b722-4957-95b0-fdcda2eadcbb tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1264 microversion: 2.1 time: 0.206250 Oct 12 18:29:32.657548 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 304/602] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:32 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1264 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:32.717764 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-12bca5e7-d74f-447a-97db-cf277f394e9f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:32.720265 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-12bca5e7-d74f-447a-97db-cf277f394e9f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:32.724739 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-770fdb91-f1a9-4db9-9884-99e2ece6ec1a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:32.725345 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-770fdb91-f1a9-4db9-9884-99e2ece6ec1a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:32.728553 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-12bca5e7-d74f-447a-97db-cf277f394e9f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:32.729180 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-12bca5e7-d74f-447a-97db-cf277f394e9f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:32.730378 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-12bca5e7-d74f-447a-97db-cf277f394e9f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:32.731058 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-12bca5e7-d74f-447a-97db-cf277f394e9f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:32.731447 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-770fdb91-f1a9-4db9-9884-99e2ece6ec1a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:32.732087 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-770fdb91-f1a9-4db9-9884-99e2ece6ec1a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:32.732674 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-770fdb91-f1a9-4db9-9884-99e2ece6ec1a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:32.733115 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-770fdb91-f1a9-4db9-9884-99e2ece6ec1a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:32.921111 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-12bca5e7-d74f-447a-97db-cf277f394e9f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:32.923700 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-770fdb91-f1a9-4db9-9884-99e2ece6ec1a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:32.932087 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-770fdb91-f1a9-4db9-9884-99e2ece6ec1a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:32.933637 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-770fdb91-f1a9-4db9-9884-99e2ece6ec1a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:32.934783 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-770fdb91-f1a9-4db9-9884-99e2ece6ec1a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1720 microversion: 2.20 time: 0.214775 Oct 12 18:29:32.935361 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 305/603] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:32 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1720 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:29:32.935521 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-12bca5e7-d74f-447a-97db-cf277f394e9f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1260 microversion: 2.1 time: 0.224382 Oct 12 18:29:32.935975 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 299/604] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:32 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1260 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:33.667574 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-afd8829a-8e4e-4b86-b2c7-13236d08bee2 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:33.668161 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-afd8829a-8e4e-4b86-b2c7-13236d08bee2 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:33.674094 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c92e3b6d-fe5c-4926-b4b3-dde99c7232a1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:33.674570 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-afd8829a-8e4e-4b86-b2c7-13236d08bee2 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:33.674570 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-afd8829a-8e4e-4b86-b2c7-13236d08bee2 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:33.674769 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c92e3b6d-fe5c-4926-b4b3-dde99c7232a1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:33.675860 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-afd8829a-8e4e-4b86-b2c7-13236d08bee2 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:33.676293 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-afd8829a-8e4e-4b86-b2c7-13236d08bee2 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:33.682565 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c92e3b6d-fe5c-4926-b4b3-dde99c7232a1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:33.683007 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c92e3b6d-fe5c-4926-b4b3-dde99c7232a1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:33.683780 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c92e3b6d-fe5c-4926-b4b3-dde99c7232a1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:33.684210 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c92e3b6d-fe5c-4926-b4b3-dde99c7232a1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:33.853776 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c92e3b6d-fe5c-4926-b4b3-dde99c7232a1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:33.865044 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-afd8829a-8e4e-4b86-b2c7-13236d08bee2 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:33.865175 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c92e3b6d-fe5c-4926-b4b3-dde99c7232a1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1264 microversion: 2.1 time: 0.191458 Oct 12 18:29:33.865175 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 300/605] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:33 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1264 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:29:33.870099 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-afd8829a-8e4e-4b86-b2c7-13236d08bee2 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1569 microversion: 2.1 time: 0.206069 Oct 12 18:29:33.870733 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 306/606] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:33 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1569 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:33.953209 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9904daed-479b-49e7-9a98-4d03ccb5e936 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:33.953817 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9904daed-479b-49e7-9a98-4d03ccb5e936 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:33.954008 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-8983926b-3190-458b-a6db-4f70714bc56a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:33.954619 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-8983926b-3190-458b-a6db-4f70714bc56a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:33.959853 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9904daed-479b-49e7-9a98-4d03ccb5e936 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:33.960290 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8983926b-3190-458b-a6db-4f70714bc56a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:33.960431 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9904daed-479b-49e7-9a98-4d03ccb5e936 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:33.960781 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8983926b-3190-458b-a6db-4f70714bc56a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:33.961240 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9904daed-479b-49e7-9a98-4d03ccb5e936 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:33.961552 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8983926b-3190-458b-a6db-4f70714bc56a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:33.961668 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9904daed-479b-49e7-9a98-4d03ccb5e936 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:33.961987 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8983926b-3190-458b-a6db-4f70714bc56a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:34.147004 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9904daed-479b-49e7-9a98-4d03ccb5e936 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:34.149474 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-8983926b-3190-458b-a6db-4f70714bc56a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:34.155026 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9904daed-479b-49e7-9a98-4d03ccb5e936 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1260 microversion: 2.1 time: 0.205502 Oct 12 18:29:34.155660 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 301/607] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:33 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1260 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:34.158339 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-8983926b-3190-458b-a6db-4f70714bc56a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:34.160347 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-8983926b-3190-458b-a6db-4f70714bc56a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:34.161681 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-8983926b-3190-458b-a6db-4f70714bc56a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1720 microversion: 2.20 time: 0.211346 Oct 12 18:29:34.162225 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 307/608] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:33 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1720 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:29:34.881778 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ba4eeb93-c075-4267-982a-8fe169be4c2f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:34.882484 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ba4eeb93-c075-4267-982a-8fe169be4c2f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:34.887027 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-02f0fcbf-4c19-4497-8b09-a57524cbe366 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:34.887630 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-02f0fcbf-4c19-4497-8b09-a57524cbe366 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:34.888276 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ba4eeb93-c075-4267-982a-8fe169be4c2f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:34.888761 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ba4eeb93-c075-4267-982a-8fe169be4c2f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:34.889537 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ba4eeb93-c075-4267-982a-8fe169be4c2f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:34.889974 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ba4eeb93-c075-4267-982a-8fe169be4c2f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:34.893821 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-02f0fcbf-4c19-4497-8b09-a57524cbe366 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:34.894852 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-02f0fcbf-4c19-4497-8b09-a57524cbe366 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:34.895626 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-02f0fcbf-4c19-4497-8b09-a57524cbe366 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:34.896053 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-02f0fcbf-4c19-4497-8b09-a57524cbe366 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:35.091230 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ba4eeb93-c075-4267-982a-8fe169be4c2f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:35.099286 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ba4eeb93-c075-4267-982a-8fe169be4c2f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1264 microversion: 2.1 time: 0.221703 Oct 12 18:29:35.099551 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-02f0fcbf-4c19-4497-8b09-a57524cbe366 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:35.100301 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 302/609] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:34 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1264 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:35.104765 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-78675bb2-f0ca-4dce-98ae-2c0e360e7e08 req-fb567981-3e00-49cb-9c91-6ae064d47a6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a13e5623-9ecd-4036-b74a-48cbb84908de", "name": "network-vif-unplugged", "status": "completed", "tag": "fabaeaf5-eee4-46bf-a4bf-984ef9955b1e"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:29:35.106391 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:29:35.106391 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:29:35.113291 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-78675bb2-f0ca-4dce-98ae-2c0e360e7e08 req-fb567981-3e00-49cb-9c91-6ae064d47a6b service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:35.113728 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-78675bb2-f0ca-4dce-98ae-2c0e360e7e08 req-fb567981-3e00-49cb-9c91-6ae064d47a6b service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:35.114059 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-02f0fcbf-4c19-4497-8b09-a57524cbe366 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1569 microversion: 2.1 time: 0.230223 Oct 12 18:29:35.115129 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 308/610] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:34 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1569 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:35.125823 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-78675bb2-f0ca-4dce-98ae-2c0e360e7e08 req-fb567981-3e00-49cb-9c91-6ae064d47a6b service nova] Creating event network-vif-unplugged:fabaeaf5-eee4-46bf-a4bf-984ef9955b1e for instance a13e5623-9ecd-4036-b74a-48cbb84908de on hv-cinder-81322 Oct 12 18:29:35.132084 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-78675bb2-f0ca-4dce-98ae-2c0e360e7e08 req-fb567981-3e00-49cb-9c91-6ae064d47a6b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030468 Oct 12 18:29:35.132883 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 303/611] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:29:35 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:29:35.171918 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-dbf4d229-cca6-4654-bf77-0857a7019049 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:35.172932 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-dbf4d229-cca6-4654-bf77-0857a7019049 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:35.181218 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8d6bffe4-3c1c-414d-8f13-884772a99d04 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:35.181764 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-dbf4d229-cca6-4654-bf77-0857a7019049 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:35.181999 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8d6bffe4-3c1c-414d-8f13-884772a99d04 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:35.182753 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-dbf4d229-cca6-4654-bf77-0857a7019049 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:35.183801 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-dbf4d229-cca6-4654-bf77-0857a7019049 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:35.185039 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-dbf4d229-cca6-4654-bf77-0857a7019049 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:35.188502 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8d6bffe4-3c1c-414d-8f13-884772a99d04 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:35.188935 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8d6bffe4-3c1c-414d-8f13-884772a99d04 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:35.191591 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8d6bffe4-3c1c-414d-8f13-884772a99d04 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:35.191591 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8d6bffe4-3c1c-414d-8f13-884772a99d04 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:35.378318 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8d6bffe4-3c1c-414d-8f13-884772a99d04 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:35.381605 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-dbf4d229-cca6-4654-bf77-0857a7019049 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:35.387234 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8d6bffe4-3c1c-414d-8f13-884772a99d04 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:35.388621 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8d6bffe4-3c1c-414d-8f13-884772a99d04 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:35.389786 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8d6bffe4-3c1c-414d-8f13-884772a99d04 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1720 microversion: 2.20 time: 0.213476 Oct 12 18:29:35.390316 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 304/612] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:35 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1720 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:29:35.390537 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-dbf4d229-cca6-4654-bf77-0857a7019049 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1260 microversion: 2.1 time: 0.222031 Oct 12 18:29:35.391429 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 309/613] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:35 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:36.117193 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-484b7bb1-83ad-4043-a214-8c86ae0c69db tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:36.117718 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-484b7bb1-83ad-4043-a214-8c86ae0c69db tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:36.124065 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-484b7bb1-83ad-4043-a214-8c86ae0c69db tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:36.124538 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-484b7bb1-83ad-4043-a214-8c86ae0c69db tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:36.125368 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-484b7bb1-83ad-4043-a214-8c86ae0c69db tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:36.125828 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-484b7bb1-83ad-4043-a214-8c86ae0c69db tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:36.136691 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-1241b27e-1aa8-4f74-bd56-810178791b02 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:36.137785 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-1241b27e-1aa8-4f74-bd56-810178791b02 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:36.148156 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1241b27e-1aa8-4f74-bd56-810178791b02 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:36.148977 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1241b27e-1aa8-4f74-bd56-810178791b02 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:36.150337 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1241b27e-1aa8-4f74-bd56-810178791b02 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:36.151124 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1241b27e-1aa8-4f74-bd56-810178791b02 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:36.270845 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-484b7bb1-83ad-4043-a214-8c86ae0c69db tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:36.278521 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-484b7bb1-83ad-4043-a214-8c86ae0c69db tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1264 microversion: 2.1 time: 0.164953 Oct 12 18:29:36.279094 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 305/614] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:36 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:36.322648 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-1241b27e-1aa8-4f74-bd56-810178791b02 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:36.330757 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-1241b27e-1aa8-4f74-bd56-810178791b02 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1569 microversion: 2.1 time: 0.200952 Oct 12 18:29:36.331333 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 310/615] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:36 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1569 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:36.406932 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-64fac890-67ba-4e6b-b5b2-ca84e088401e tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:36.407311 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c803cc2d-82b6-43ac-a29f-712e8a55b5a3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:36.407542 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-64fac890-67ba-4e6b-b5b2-ca84e088401e tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:36.407913 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c803cc2d-82b6-43ac-a29f-712e8a55b5a3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:36.414911 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c803cc2d-82b6-43ac-a29f-712e8a55b5a3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:36.415158 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-64fac890-67ba-4e6b-b5b2-ca84e088401e tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:36.415356 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c803cc2d-82b6-43ac-a29f-712e8a55b5a3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:36.415502 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-64fac890-67ba-4e6b-b5b2-ca84e088401e tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:36.416172 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c803cc2d-82b6-43ac-a29f-712e8a55b5a3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:36.416278 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-64fac890-67ba-4e6b-b5b2-ca84e088401e tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:36.416616 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c803cc2d-82b6-43ac-a29f-712e8a55b5a3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:36.416746 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-64fac890-67ba-4e6b-b5b2-ca84e088401e tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:36.592551 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c803cc2d-82b6-43ac-a29f-712e8a55b5a3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:36.600533 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-64fac890-67ba-4e6b-b5b2-ca84e088401e tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:36.601026 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c803cc2d-82b6-43ac-a29f-712e8a55b5a3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:36.602519 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c803cc2d-82b6-43ac-a29f-712e8a55b5a3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:36.603714 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c803cc2d-82b6-43ac-a29f-712e8a55b5a3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1720 microversion: 2.20 time: 0.200008 Oct 12 18:29:36.604270 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 311/616] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:36 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1720 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:29:36.607906 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-64fac890-67ba-4e6b-b5b2-ca84e088401e tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1260 microversion: 2.1 time: 0.204560 Oct 12 18:29:36.608622 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 306/617] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:36 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1260 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:37.294998 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-5e81b6fb-814f-444c-b271-cd0eea1fa9c0 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:37.295603 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-5e81b6fb-814f-444c-b271-cd0eea1fa9c0 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:37.301459 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5e81b6fb-814f-444c-b271-cd0eea1fa9c0 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:37.301896 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5e81b6fb-814f-444c-b271-cd0eea1fa9c0 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:37.302648 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5e81b6fb-814f-444c-b271-cd0eea1fa9c0 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:37.303148 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5e81b6fb-814f-444c-b271-cd0eea1fa9c0 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:37.348106 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3d634ef0-8245-4102-bfaf-d9a40bf10cb4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:37.348835 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3d634ef0-8245-4102-bfaf-d9a40bf10cb4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:37.355058 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3d634ef0-8245-4102-bfaf-d9a40bf10cb4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:37.355507 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3d634ef0-8245-4102-bfaf-d9a40bf10cb4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:37.356285 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3d634ef0-8245-4102-bfaf-d9a40bf10cb4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:37.356747 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3d634ef0-8245-4102-bfaf-d9a40bf10cb4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:37.461896 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-5e81b6fb-814f-444c-b271-cd0eea1fa9c0 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:37.469534 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-5e81b6fb-814f-444c-b271-cd0eea1fa9c0 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1451 microversion: 2.1 time: 0.178106 Oct 12 18:29:37.470097 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 312/618] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:37 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1451 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:37.487334 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-47e3d797-5208-4355-b20c-0fd6ffc20a52 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:37.488463 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-47e3d797-5208-4355-b20c-0fd6ffc20a52 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:37.495888 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-47e3d797-5208-4355-b20c-0fd6ffc20a52 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:37.496360 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-47e3d797-5208-4355-b20c-0fd6ffc20a52 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:37.497782 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-47e3d797-5208-4355-b20c-0fd6ffc20a52 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:37.498255 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-47e3d797-5208-4355-b20c-0fd6ffc20a52 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:37.509445 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3d634ef0-8245-4102-bfaf-d9a40bf10cb4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:37.517530 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3d634ef0-8245-4102-bfaf-d9a40bf10cb4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1569 microversion: 2.1 time: 0.173136 Oct 12 18:29:37.518025 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 307/619] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:37 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:29:37.622644 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0466be33-4398-4f23-9287-fe83c74b11e5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:37.623248 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0466be33-4398-4f23-9287-fe83c74b11e5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:37.629576 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-47e3d797-5208-4355-b20c-0fd6ffc20a52 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:37.632610 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0466be33-4398-4f23-9287-fe83c74b11e5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:37.633398 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0466be33-4398-4f23-9287-fe83c74b11e5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:37.634417 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0466be33-4398-4f23-9287-fe83c74b11e5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:37.634939 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0466be33-4398-4f23-9287-fe83c74b11e5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:37.636861 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-47e3d797-5208-4355-b20c-0fd6ffc20a52 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1451 microversion: 2.1 time: 0.153081 Oct 12 18:29:37.637613 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 313/620] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:37 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:29:37.641965 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-2ba77e3e-81f0-42bc-a416-0952f269a800 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:37.642566 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-2ba77e3e-81f0-42bc-a416-0952f269a800 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:37.650146 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2ba77e3e-81f0-42bc-a416-0952f269a800 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:37.650588 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2ba77e3e-81f0-42bc-a416-0952f269a800 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:37.651361 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2ba77e3e-81f0-42bc-a416-0952f269a800 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:37.651785 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2ba77e3e-81f0-42bc-a416-0952f269a800 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:37.835071 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0466be33-4398-4f23-9287-fe83c74b11e5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:37.839359 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-2ba77e3e-81f0-42bc-a416-0952f269a800 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:37.846206 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0466be33-4398-4f23-9287-fe83c74b11e5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:37.846206 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0466be33-4398-4f23-9287-fe83c74b11e5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:37.847386 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0466be33-4398-4f23-9287-fe83c74b11e5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1720 microversion: 2.20 time: 0.228153 Oct 12 18:29:37.848013 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-2ba77e3e-81f0-42bc-a416-0952f269a800 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1260 microversion: 2.1 time: 0.209361 Oct 12 18:29:37.848796 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 314/621] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:37 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1260 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:37.857934 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 308/622] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:37 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1720 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:29:38.534544 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-f386d631-8bbd-4509-9daa-85ecb30bab92 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:38.536473 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-f386d631-8bbd-4509-9daa-85ecb30bab92 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:38.549164 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f386d631-8bbd-4509-9daa-85ecb30bab92 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:38.549614 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f386d631-8bbd-4509-9daa-85ecb30bab92 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:38.550813 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f386d631-8bbd-4509-9daa-85ecb30bab92 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:38.551359 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f386d631-8bbd-4509-9daa-85ecb30bab92 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:38.769669 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-f386d631-8bbd-4509-9daa-85ecb30bab92 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:38.778725 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-f386d631-8bbd-4509-9daa-85ecb30bab92 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1569 microversion: 2.1 time: 0.248189 Oct 12 18:29:38.779627 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 315/623] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:38 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1569 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:38.864741 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-75ef5400-04d3-4c89-aaa3-6a18917c2ff7 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:38.865362 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-75ef5400-04d3-4c89-aaa3-6a18917c2ff7 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:38.871455 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-f631ca76-f0d2-422d-887e-a9841529d9b3 req-722f255c-2bb6-46af-8f42-36906dd50956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f0cf04d-323c-4749-b9ae-d35333eb565c", "name": "network-vif-plugged", "status": "completed", "tag": "ee9e0115-2251-43e7-8da4-8dd846258e7b"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:29:38.873786 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:29:38.873786 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:29:38.881725 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-75ef5400-04d3-4c89-aaa3-6a18917c2ff7 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:38.886375 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-75ef5400-04d3-4c89-aaa3-6a18917c2ff7 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:38.886375 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-75ef5400-04d3-4c89-aaa3-6a18917c2ff7 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:38.886375 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-75ef5400-04d3-4c89-aaa3-6a18917c2ff7 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:38.886798 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-f631ca76-f0d2-422d-887e-a9841529d9b3 req-722f255c-2bb6-46af-8f42-36906dd50956 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:38.886798 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-f631ca76-f0d2-422d-887e-a9841529d9b3 req-722f255c-2bb6-46af-8f42-36906dd50956 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:38.897108 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-f631ca76-f0d2-422d-887e-a9841529d9b3 req-722f255c-2bb6-46af-8f42-36906dd50956 service nova] Creating event network-vif-plugged:ee9e0115-2251-43e7-8da4-8dd846258e7b for instance 1f0cf04d-323c-4749-b9ae-d35333eb565c on hv-cinder-81322 Oct 12 18:29:38.902446 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-f631ca76-f0d2-422d-887e-a9841529d9b3 req-722f255c-2bb6-46af-8f42-36906dd50956 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034131 Oct 12 18:29:38.903229 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 309/624] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:29:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:29:38.909585 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1adf95c5-e91d-45c6-a458-a59123cd2c2c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:38.911043 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1adf95c5-e91d-45c6-a458-a59123cd2c2c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:38.919459 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1adf95c5-e91d-45c6-a458-a59123cd2c2c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:38.920352 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1adf95c5-e91d-45c6-a458-a59123cd2c2c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:38.921369 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1adf95c5-e91d-45c6-a458-a59123cd2c2c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:38.922404 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1adf95c5-e91d-45c6-a458-a59123cd2c2c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:39.110825 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-75ef5400-04d3-4c89-aaa3-6a18917c2ff7 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:39.119157 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-75ef5400-04d3-4c89-aaa3-6a18917c2ff7 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1260 microversion: 2.1 time: 0.257982 Oct 12 18:29:39.120106 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 316/625] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:38 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1260 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:39.124030 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1adf95c5-e91d-45c6-a458-a59123cd2c2c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:39.133112 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1adf95c5-e91d-45c6-a458-a59123cd2c2c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:39.134597 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1adf95c5-e91d-45c6-a458-a59123cd2c2c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:39.135747 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1adf95c5-e91d-45c6-a458-a59123cd2c2c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1720 microversion: 2.20 time: 0.230144 Oct 12 18:29:39.136330 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 310/626] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:38 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1720 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:29:39.795191 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-ff5844cf-3b40-4307-a5eb-bc9e4b608071 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:39.795949 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-ff5844cf-3b40-4307-a5eb-bc9e4b608071 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:39.803982 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ff5844cf-3b40-4307-a5eb-bc9e4b608071 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:39.804473 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ff5844cf-3b40-4307-a5eb-bc9e4b608071 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:39.805473 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ff5844cf-3b40-4307-a5eb-bc9e4b608071 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:39.805910 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ff5844cf-3b40-4307-a5eb-bc9e4b608071 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:40.023043 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-ff5844cf-3b40-4307-a5eb-bc9e4b608071 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:40.031797 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-ff5844cf-3b40-4307-a5eb-bc9e4b608071 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1569 microversion: 2.1 time: 0.240290 Oct 12 18:29:40.032366 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 317/627] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:39 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1569 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:40.135822 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5a2aef20-9ec6-4b22-a2c8-01a8f4f4f832 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:40.136469 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5a2aef20-9ec6-4b22-a2c8-01a8f4f4f832 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:40.142401 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5a2aef20-9ec6-4b22-a2c8-01a8f4f4f832 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:40.142851 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5a2aef20-9ec6-4b22-a2c8-01a8f4f4f832 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:40.143622 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5a2aef20-9ec6-4b22-a2c8-01a8f4f4f832 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:40.144665 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5a2aef20-9ec6-4b22-a2c8-01a8f4f4f832 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:40.175314 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-6427b15c-84bf-45bd-9183-0d0b9f2241f9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:40.175314 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-6427b15c-84bf-45bd-9183-0d0b9f2241f9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:40.175314 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6427b15c-84bf-45bd-9183-0d0b9f2241f9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:40.175314 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6427b15c-84bf-45bd-9183-0d0b9f2241f9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:40.175810 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6427b15c-84bf-45bd-9183-0d0b9f2241f9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:40.175810 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6427b15c-84bf-45bd-9183-0d0b9f2241f9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:40.399629 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5a2aef20-9ec6-4b22-a2c8-01a8f4f4f832 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:40.409174 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5a2aef20-9ec6-4b22-a2c8-01a8f4f4f832 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1260 microversion: 2.1 time: 0.276895 Oct 12 18:29:40.414162 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 311/628] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:40 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1260 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:40.418590 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-6427b15c-84bf-45bd-9183-0d0b9f2241f9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:40.428229 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-6427b15c-84bf-45bd-9183-0d0b9f2241f9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:40.429776 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-6427b15c-84bf-45bd-9183-0d0b9f2241f9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:40.430966 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-6427b15c-84bf-45bd-9183-0d0b9f2241f9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1663 microversion: 2.20 time: 0.272672 Oct 12 18:29:40.431533 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 318/629] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:40 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1663 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:29:40.449881 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e4d893df-a65d-485c-bb45-4de27052e5ca tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0039d52-f534-4fe3-a649-594d65f2d3bf"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:29:40.451013 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e4d893df-a65d-485c-bb45-4de27052e5ca tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:40.457398 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e4d893df-a65d-485c-bb45-4de27052e5ca tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:40.457847 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e4d893df-a65d-485c-bb45-4de27052e5ca tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:40.458636 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e4d893df-a65d-485c-bb45-4de27052e5ca tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:40.459150 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e4d893df-a65d-485c-bb45-4de27052e5ca tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:40.505623 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-40cb77c8-e96b-4742-9e03-ef44e3538101 req-83b8f803-a0de-42f6-ad0e-3a60f8ae901b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff8be5be-6f8c-42e2-9cd4-10c62915f993", "tag": "e9e1d074-c7de-4406-9644-edcd2e1b0059"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:29:40.507180 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:29:40.507180 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:29:40.515141 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-40cb77c8-e96b-4742-9e03-ef44e3538101 req-83b8f803-a0de-42f6-ad0e-3a60f8ae901b service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:40.515583 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-40cb77c8-e96b-4742-9e03-ef44e3538101 req-83b8f803-a0de-42f6-ad0e-3a60f8ae901b service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:40.526763 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-40cb77c8-e96b-4742-9e03-ef44e3538101 req-83b8f803-a0de-42f6-ad0e-3a60f8ae901b service nova] Creating event network-changed:e9e1d074-c7de-4406-9644-edcd2e1b0059 for instance ff8be5be-6f8c-42e2-9cd4-10c62915f993 on hv-cinder-81322 Oct 12 18:29:40.532252 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-40cb77c8-e96b-4742-9e03-ef44e3538101 req-83b8f803-a0de-42f6-ad0e-3a60f8ae901b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031056 Oct 12 18:29:40.533211 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 319/630] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:29:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 18:29:41.049089 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-732f9e09-d3d3-430a-b545-d93f2cc02d1a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:41.051036 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-732f9e09-d3d3-430a-b545-d93f2cc02d1a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:41.057313 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-732f9e09-d3d3-430a-b545-d93f2cc02d1a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:41.057763 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-732f9e09-d3d3-430a-b545-d93f2cc02d1a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:41.058542 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-732f9e09-d3d3-430a-b545-d93f2cc02d1a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:41.058976 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-732f9e09-d3d3-430a-b545-d93f2cc02d1a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:41.190807 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-732f9e09-d3d3-430a-b545-d93f2cc02d1a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:41.199299 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-732f9e09-d3d3-430a-b545-d93f2cc02d1a tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1569 microversion: 2.1 time: 0.154042 Oct 12 18:29:41.199856 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 320/631] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:41 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:29:41.426359 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-ef9b4d10-443c-4a5c-83ee-ec64850db0b0 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:41.427083 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-ef9b4d10-443c-4a5c-83ee-ec64850db0b0 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:41.433252 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ef9b4d10-443c-4a5c-83ee-ec64850db0b0 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:41.437018 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ef9b4d10-443c-4a5c-83ee-ec64850db0b0 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:41.437018 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ef9b4d10-443c-4a5c-83ee-ec64850db0b0 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:41.437018 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ef9b4d10-443c-4a5c-83ee-ec64850db0b0 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:41.519579 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e4d893df-a65d-485c-bb45-4de27052e5ca tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.072874 Oct 12 18:29:41.525129 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 312/632] 10.222.0.18 () {62 vars in 1363 bytes} [Tue Oct 12 18:29:40 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/os-volume_attachments => generated 188 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:29:41.579180 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-ef9b4d10-443c-4a5c-83ee-ec64850db0b0 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:41.595131 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-ef9b4d10-443c-4a5c-83ee-ec64850db0b0 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1260 microversion: 2.1 time: 0.172473 Oct 12 18:29:41.595871 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 321/633] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:41 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:29:41.656302 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-dc9131b0-35dd-4e6f-be25-8370918daa6e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:29:41.656895 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-dc9131b0-35dd-4e6f-be25-8370918daa6e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:41.664219 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dc9131b0-35dd-4e6f-be25-8370918daa6e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:41.664702 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dc9131b0-35dd-4e6f-be25-8370918daa6e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:41.665481 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dc9131b0-35dd-4e6f-be25-8370918daa6e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:41.665919 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dc9131b0-35dd-4e6f-be25-8370918daa6e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:41.966036 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-dc9131b0-35dd-4e6f-be25-8370918daa6e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action" status: 202 len: 0 microversion: 2.20 time: 0.313666 Oct 12 18:29:41.966683 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 313/634] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:29:41 2021] POST /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 18:29:41.974612 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-87957a5d-c604-4b58-8dc1-267d478d1693 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:41.975182 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-87957a5d-c604-4b58-8dc1-267d478d1693 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:41.981123 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-87957a5d-c604-4b58-8dc1-267d478d1693 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:41.981564 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-87957a5d-c604-4b58-8dc1-267d478d1693 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:41.982331 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-87957a5d-c604-4b58-8dc1-267d478d1693 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:41.982758 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-87957a5d-c604-4b58-8dc1-267d478d1693 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:42.107706 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-87957a5d-c604-4b58-8dc1-267d478d1693 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:42.116564 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-87957a5d-c604-4b58-8dc1-267d478d1693 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:42.118283 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-87957a5d-c604-4b58-8dc1-267d478d1693 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:42.119447 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-87957a5d-c604-4b58-8dc1-267d478d1693 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1749 microversion: 2.20 time: 0.148595 Oct 12 18:29:42.120080 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 322/635] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:41 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1749 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:29:42.217591 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-674b3f26-77e1-4f95-85dd-1dcb719524b7 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:42.218110 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-674b3f26-77e1-4f95-85dd-1dcb719524b7 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:42.226735 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-674b3f26-77e1-4f95-85dd-1dcb719524b7 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:42.226735 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-674b3f26-77e1-4f95-85dd-1dcb719524b7 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:42.226735 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-674b3f26-77e1-4f95-85dd-1dcb719524b7 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:42.227071 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-674b3f26-77e1-4f95-85dd-1dcb719524b7 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:42.361463 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-674b3f26-77e1-4f95-85dd-1dcb719524b7 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:42.372810 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-674b3f26-77e1-4f95-85dd-1dcb719524b7 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1569 microversion: 2.1 time: 0.158844 Oct 12 18:29:42.373632 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 314/636] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:42 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:42.612943 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-5c4f26c0-3412-40c5-a286-a3ca8027e2bc tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:42.613672 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-5c4f26c0-3412-40c5-a286-a3ca8027e2bc tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:42.620608 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5c4f26c0-3412-40c5-a286-a3ca8027e2bc tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:42.621050 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5c4f26c0-3412-40c5-a286-a3ca8027e2bc tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:42.621830 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5c4f26c0-3412-40c5-a286-a3ca8027e2bc tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:42.622257 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5c4f26c0-3412-40c5-a286-a3ca8027e2bc tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:42.786228 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-5c4f26c0-3412-40c5-a286-a3ca8027e2bc tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:42.794938 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-5c4f26c0-3412-40c5-a286-a3ca8027e2bc tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1444 microversion: 2.1 time: 0.185749 Oct 12 18:29:42.795604 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 323/637] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:42 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1444 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:42.811891 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2a465cbe-672a-4e7e-ad3d-f0fb740016e3 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:42.812457 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2a465cbe-672a-4e7e-ad3d-f0fb740016e3 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:42.819279 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2a465cbe-672a-4e7e-ad3d-f0fb740016e3 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:42.819731 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2a465cbe-672a-4e7e-ad3d-f0fb740016e3 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:42.820548 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2a465cbe-672a-4e7e-ad3d-f0fb740016e3 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:42.820981 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2a465cbe-672a-4e7e-ad3d-f0fb740016e3 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:42.948392 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2a465cbe-672a-4e7e-ad3d-f0fb740016e3 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:42.958716 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2a465cbe-672a-4e7e-ad3d-f0fb740016e3 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1444 microversion: 2.1 time: 0.150398 Oct 12 18:29:42.959298 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 315/638] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:42 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:43.138859 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-d3aa05cb-a0ff-4010-9cd6-70c1650b574d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:43.140214 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-d3aa05cb-a0ff-4010-9cd6-70c1650b574d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:43.145908 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d3aa05cb-a0ff-4010-9cd6-70c1650b574d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:43.146373 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d3aa05cb-a0ff-4010-9cd6-70c1650b574d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:43.147353 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d3aa05cb-a0ff-4010-9cd6-70c1650b574d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:43.147790 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d3aa05cb-a0ff-4010-9cd6-70c1650b574d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:43.317349 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-d3aa05cb-a0ff-4010-9cd6-70c1650b574d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:43.330098 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-d3aa05cb-a0ff-4010-9cd6-70c1650b574d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:43.331833 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-d3aa05cb-a0ff-4010-9cd6-70c1650b574d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:43.333238 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-d3aa05cb-a0ff-4010-9cd6-70c1650b574d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1749 microversion: 2.20 time: 0.197997 Oct 12 18:29:43.336813 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 324/639] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:43 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1749 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:29:43.390857 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-cd4c9aa3-538f-459e-bf7d-56d52d7bf450 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:43.396365 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-cd4c9aa3-538f-459e-bf7d-56d52d7bf450 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:43.398875 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cd4c9aa3-538f-459e-bf7d-56d52d7bf450 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:43.399508 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cd4c9aa3-538f-459e-bf7d-56d52d7bf450 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:43.400533 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cd4c9aa3-538f-459e-bf7d-56d52d7bf450 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:43.401149 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cd4c9aa3-538f-459e-bf7d-56d52d7bf450 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:43.697244 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-cd4c9aa3-538f-459e-bf7d-56d52d7bf450 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:43.720991 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-cd4c9aa3-538f-459e-bf7d-56d52d7bf450 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1569 microversion: 2.1 time: 0.333539 Oct 12 18:29:43.721584 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 316/640] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:43 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1569 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:29:44.351307 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-a7c4ba88-bb20-433e-a133-5a255fdf1ac3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:44.351898 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-a7c4ba88-bb20-433e-a133-5a255fdf1ac3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:44.358455 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a7c4ba88-bb20-433e-a133-5a255fdf1ac3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:44.358901 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a7c4ba88-bb20-433e-a133-5a255fdf1ac3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:44.360293 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a7c4ba88-bb20-433e-a133-5a255fdf1ac3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:44.360940 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a7c4ba88-bb20-433e-a133-5a255fdf1ac3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:44.740666 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-bbf30c3c-f730-4720-a63d-2e0e6d41aac3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:44.741274 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-bbf30c3c-f730-4720-a63d-2e0e6d41aac3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:44.748508 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bbf30c3c-f730-4720-a63d-2e0e6d41aac3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:44.749072 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bbf30c3c-f730-4720-a63d-2e0e6d41aac3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:44.749946 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bbf30c3c-f730-4720-a63d-2e0e6d41aac3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:44.750590 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bbf30c3c-f730-4720-a63d-2e0e6d41aac3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:44.894356 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-a7c4ba88-bb20-433e-a133-5a255fdf1ac3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:44.904512 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-a7c4ba88-bb20-433e-a133-5a255fdf1ac3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:44.906042 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-a7c4ba88-bb20-433e-a133-5a255fdf1ac3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:44.907214 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-a7c4ba88-bb20-433e-a133-5a255fdf1ac3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1751 microversion: 2.20 time: 0.559667 Oct 12 18:29:44.908586 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 325/641] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:44 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1751 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:29:45.053130 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-bbf30c3c-f730-4720-a63d-2e0e6d41aac3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:45.060852 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-bbf30c3c-f730-4720-a63d-2e0e6d41aac3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1569 microversion: 2.1 time: 0.324857 Oct 12 18:29:45.061415 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 317/642] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:44 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1569 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:45.927864 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c1dbdc00-d90b-48de-b5f3-86be216c71b5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:45.928697 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c1dbdc00-d90b-48de-b5f3-86be216c71b5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:45.934831 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c1dbdc00-d90b-48de-b5f3-86be216c71b5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:45.935764 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c1dbdc00-d90b-48de-b5f3-86be216c71b5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:45.936675 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c1dbdc00-d90b-48de-b5f3-86be216c71b5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:45.937184 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c1dbdc00-d90b-48de-b5f3-86be216c71b5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:46.078699 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-405df3dc-a019-4400-929a-82e20ec535f9 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:46.079318 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-405df3dc-a019-4400-929a-82e20ec535f9 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:46.086674 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-405df3dc-a019-4400-929a-82e20ec535f9 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:46.087283 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-405df3dc-a019-4400-929a-82e20ec535f9 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:46.088447 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-405df3dc-a019-4400-929a-82e20ec535f9 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:46.088877 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-405df3dc-a019-4400-929a-82e20ec535f9 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:46.238980 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c1dbdc00-d90b-48de-b5f3-86be216c71b5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:46.249008 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c1dbdc00-d90b-48de-b5f3-86be216c71b5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:46.250910 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c1dbdc00-d90b-48de-b5f3-86be216c71b5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:46.252280 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c1dbdc00-d90b-48de-b5f3-86be216c71b5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1807 microversion: 2.20 time: 0.329088 Oct 12 18:29:46.264124 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 326/643] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:45 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1807 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:29:46.264124 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-727dc663-e0a7-44eb-887d-11ae05827d5f req-bda8f440-7d31-455e-ae6f-57ab0d97ccf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f0cf04d-323c-4749-b9ae-d35333eb565c", "tag": "ee9e0115-2251-43e7-8da4-8dd846258e7b"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:29:46.264124 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:29:46.264124 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:29:46.271788 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-727dc663-e0a7-44eb-887d-11ae05827d5f req-bda8f440-7d31-455e-ae6f-57ab0d97ccf4 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:46.272640 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-727dc663-e0a7-44eb-887d-11ae05827d5f req-bda8f440-7d31-455e-ae6f-57ab0d97ccf4 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:46.287741 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-727dc663-e0a7-44eb-887d-11ae05827d5f req-bda8f440-7d31-455e-ae6f-57ab0d97ccf4 service nova] Creating event network-changed:ee9e0115-2251-43e7-8da4-8dd846258e7b for instance 1f0cf04d-323c-4749-b9ae-d35333eb565c on hv-cinder-81322 Oct 12 18:29:46.295013 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-727dc663-e0a7-44eb-887d-11ae05827d5f req-bda8f440-7d31-455e-ae6f-57ab0d97ccf4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040058 Oct 12 18:29:46.296557 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 327/644] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:29:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:29:46.322634 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-405df3dc-a019-4400-929a-82e20ec535f9 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:46.332377 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-405df3dc-a019-4400-929a-82e20ec535f9 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1549 microversion: 2.1 time: 0.258235 Oct 12 18:29:46.333190 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 318/645] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:46 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1549 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:29:46.350525 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-3206a653-7392-45f8-bf6e-06db094e56bd tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:46.351150 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-3206a653-7392-45f8-bf6e-06db094e56bd tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:46.359662 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3206a653-7392-45f8-bf6e-06db094e56bd tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:46.360240 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3206a653-7392-45f8-bf6e-06db094e56bd tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:46.361491 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3206a653-7392-45f8-bf6e-06db094e56bd tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:46.361940 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3206a653-7392-45f8-bf6e-06db094e56bd tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:46.500812 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.wsgi [None req-3206a653-7392-45f8-bf6e-06db094e56bd tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] HTTP exception thrown: Cannot 'detach_volume' instance 4ade368f-e898-4346-83a8-3d3eb86c8192 while it is in vm_state rescued Oct 12 18:29:46.501540 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-3206a653-7392-45f8-bf6e-06db094e56bd tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Returning 409 to user: Cannot 'detach_volume' instance 4ade368f-e898-4346-83a8-3d3eb86c8192 while it is in vm_state rescued {{(pid=109169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:29:46.502597 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-3206a653-7392-45f8-bf6e-06db094e56bd tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192/os-volume_attachments/d5731d78-ed20-43fb-8946-44d58a6d0c98" status: 409 len: 152 microversion: 2.1 time: 0.157575 Oct 12 18:29:46.504101 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 328/646] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Oct 12 18:29:46 2021] DELETE /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192/os-volume_attachments/d5731d78-ed20-43fb-8946-44d58a6d0c98 => generated 152 bytes in 160 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 18:29:46.512148 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e141598a-0035-4aaf-9245-7d6e7587162b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:29:46.512694 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e141598a-0035-4aaf-9245-7d6e7587162b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:46.518446 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e141598a-0035-4aaf-9245-7d6e7587162b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:46.518902 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e141598a-0035-4aaf-9245-7d6e7587162b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:46.519675 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e141598a-0035-4aaf-9245-7d6e7587162b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:46.520104 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e141598a-0035-4aaf-9245-7d6e7587162b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:46.961519 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e141598a-0035-4aaf-9245-7d6e7587162b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "POST /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192/action" status: 202 len: 0 microversion: 2.1 time: 0.452722 Oct 12 18:29:46.972808 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 319/647] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:29:46 2021] POST /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:29:46.977791 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-453ab55e-d15a-4143-9706-9042fa2159b5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:46.978392 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-453ab55e-d15a-4143-9706-9042fa2159b5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:46.987001 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-453ab55e-d15a-4143-9706-9042fa2159b5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:46.988064 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-453ab55e-d15a-4143-9706-9042fa2159b5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:46.992209 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-453ab55e-d15a-4143-9706-9042fa2159b5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:46.992634 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-453ab55e-d15a-4143-9706-9042fa2159b5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:47.242441 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-453ab55e-d15a-4143-9706-9042fa2159b5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:47.242441 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-453ab55e-d15a-4143-9706-9042fa2159b5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1557 microversion: 2.1 time: 0.174766 Oct 12 18:29:47.242441 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 329/648] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:46 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1557 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:47.280853 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2a427154-ed75-4d7b-91b9-d0c4fcf72faf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:47.280853 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2a427154-ed75-4d7b-91b9-d0c4fcf72faf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:47.280853 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2a427154-ed75-4d7b-91b9-d0c4fcf72faf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:47.280853 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2a427154-ed75-4d7b-91b9-d0c4fcf72faf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:47.282729 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2a427154-ed75-4d7b-91b9-d0c4fcf72faf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:47.282729 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2a427154-ed75-4d7b-91b9-d0c4fcf72faf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:47.399292 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2a427154-ed75-4d7b-91b9-d0c4fcf72faf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:47.408232 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2a427154-ed75-4d7b-91b9-d0c4fcf72faf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:47.409792 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2a427154-ed75-4d7b-91b9-d0c4fcf72faf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:47.411244 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2a427154-ed75-4d7b-91b9-d0c4fcf72faf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1807 microversion: 2.20 time: 0.143766 Oct 12 18:29:47.411637 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 320/649] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:47 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1807 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:29:48.249477 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-e0abc328-2b0c-4b93-8dd0-45fa59df10f3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:48.250150 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-e0abc328-2b0c-4b93-8dd0-45fa59df10f3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:48.258364 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e0abc328-2b0c-4b93-8dd0-45fa59df10f3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:48.261375 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e0abc328-2b0c-4b93-8dd0-45fa59df10f3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:48.261375 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e0abc328-2b0c-4b93-8dd0-45fa59df10f3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:48.261375 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e0abc328-2b0c-4b93-8dd0-45fa59df10f3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:48.383453 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-e0abc328-2b0c-4b93-8dd0-45fa59df10f3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:48.393016 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-e0abc328-2b0c-4b93-8dd0-45fa59df10f3 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1557 microversion: 2.1 time: 0.147322 Oct 12 18:29:48.399056 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 330/650] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:48 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:48.429797 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ac44bdd7-1f15-418e-a279-6dd9da14252d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:48.430431 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ac44bdd7-1f15-418e-a279-6dd9da14252d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:48.437168 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ac44bdd7-1f15-418e-a279-6dd9da14252d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:48.437958 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ac44bdd7-1f15-418e-a279-6dd9da14252d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:48.439058 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ac44bdd7-1f15-418e-a279-6dd9da14252d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:48.439643 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ac44bdd7-1f15-418e-a279-6dd9da14252d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:48.564728 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ac44bdd7-1f15-418e-a279-6dd9da14252d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:48.573264 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ac44bdd7-1f15-418e-a279-6dd9da14252d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:48.574744 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ac44bdd7-1f15-418e-a279-6dd9da14252d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:48.575882 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ac44bdd7-1f15-418e-a279-6dd9da14252d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1807 microversion: 2.20 time: 0.149780 Oct 12 18:29:48.576468 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 321/651] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:48 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:29:49.411548 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-41e50cca-5044-41b2-8632-8e54087048ec tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:49.412239 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-41e50cca-5044-41b2-8632-8e54087048ec tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:49.419128 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-41e50cca-5044-41b2-8632-8e54087048ec tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:49.419641 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-41e50cca-5044-41b2-8632-8e54087048ec tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:49.420507 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-41e50cca-5044-41b2-8632-8e54087048ec tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:49.420942 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-41e50cca-5044-41b2-8632-8e54087048ec tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:49.546735 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-41e50cca-5044-41b2-8632-8e54087048ec tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:49.555246 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-41e50cca-5044-41b2-8632-8e54087048ec tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1557 microversion: 2.1 time: 0.148008 Oct 12 18:29:49.556011 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 331/652] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:49 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:49.594946 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d0eb252c-b9d7-4849-9653-947e7d095b78 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:49.595529 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d0eb252c-b9d7-4849-9653-947e7d095b78 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:49.601478 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d0eb252c-b9d7-4849-9653-947e7d095b78 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:49.601920 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d0eb252c-b9d7-4849-9653-947e7d095b78 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:49.602681 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d0eb252c-b9d7-4849-9653-947e7d095b78 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:49.603111 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d0eb252c-b9d7-4849-9653-947e7d095b78 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:49.729077 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d0eb252c-b9d7-4849-9653-947e7d095b78 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:49.737683 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d0eb252c-b9d7-4849-9653-947e7d095b78 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:49.739181 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d0eb252c-b9d7-4849-9653-947e7d095b78 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:49.740338 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d0eb252c-b9d7-4849-9653-947e7d095b78 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1807 microversion: 2.20 time: 0.149203 Oct 12 18:29:49.740918 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 322/653] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:49 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:29:50.572552 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-32e64144-4a3e-4e83-a138-5856d1cb01f6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:50.573997 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-32e64144-4a3e-4e83-a138-5856d1cb01f6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:50.580657 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-32e64144-4a3e-4e83-a138-5856d1cb01f6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:50.581692 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-32e64144-4a3e-4e83-a138-5856d1cb01f6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:50.582475 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-32e64144-4a3e-4e83-a138-5856d1cb01f6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:50.582895 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-32e64144-4a3e-4e83-a138-5856d1cb01f6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:50.706219 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-32e64144-4a3e-4e83-a138-5856d1cb01f6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:50.714616 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-32e64144-4a3e-4e83-a138-5856d1cb01f6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1557 microversion: 2.1 time: 0.146014 Oct 12 18:29:50.715195 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 332/654] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:50 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:50.759460 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b9eee805-c61a-436f-a02b-f8483afb5bfa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:50.760064 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b9eee805-c61a-436f-a02b-f8483afb5bfa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:50.765907 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b9eee805-c61a-436f-a02b-f8483afb5bfa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:50.766350 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b9eee805-c61a-436f-a02b-f8483afb5bfa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:50.767109 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b9eee805-c61a-436f-a02b-f8483afb5bfa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:50.767541 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b9eee805-c61a-436f-a02b-f8483afb5bfa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:50.892493 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b9eee805-c61a-436f-a02b-f8483afb5bfa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:50.901295 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b9eee805-c61a-436f-a02b-f8483afb5bfa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:50.903161 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b9eee805-c61a-436f-a02b-f8483afb5bfa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:50.904333 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b9eee805-c61a-436f-a02b-f8483afb5bfa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1807 microversion: 2.20 time: 0.148612 Oct 12 18:29:50.904959 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 323/655] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:50 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:29:51.732113 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-dec442f7-4758-4f78-967f-43f55231f866 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:51.732720 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-dec442f7-4758-4f78-967f-43f55231f866 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:51.739607 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-dec442f7-4758-4f78-967f-43f55231f866 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:51.740120 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-dec442f7-4758-4f78-967f-43f55231f866 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:51.740920 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-dec442f7-4758-4f78-967f-43f55231f866 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:51.741344 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-dec442f7-4758-4f78-967f-43f55231f866 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:51.872797 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-dec442f7-4758-4f78-967f-43f55231f866 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:51.882544 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-dec442f7-4758-4f78-967f-43f55231f866 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1557 microversion: 2.1 time: 0.153949 Oct 12 18:29:51.883447 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 333/656] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:51 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:51.923316 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-366c8b35-949e-4062-993b-b7f762059825 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:51.923927 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-366c8b35-949e-4062-993b-b7f762059825 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:51.930627 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-366c8b35-949e-4062-993b-b7f762059825 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:51.931077 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-366c8b35-949e-4062-993b-b7f762059825 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:51.931866 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-366c8b35-949e-4062-993b-b7f762059825 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:51.932503 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-366c8b35-949e-4062-993b-b7f762059825 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:52.074242 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-366c8b35-949e-4062-993b-b7f762059825 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:52.083109 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-366c8b35-949e-4062-993b-b7f762059825 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:52.084668 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-366c8b35-949e-4062-993b-b7f762059825 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:52.085793 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-366c8b35-949e-4062-993b-b7f762059825 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1807 microversion: 2.20 time: 0.166687 Oct 12 18:29:52.086336 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 324/657] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:51 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:29:52.900519 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-53f7c6a1-14e8-4145-b5ac-432eeb657dcd tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:52.902468 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-53f7c6a1-14e8-4145-b5ac-432eeb657dcd tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:52.907260 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-53f7c6a1-14e8-4145-b5ac-432eeb657dcd tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:52.907708 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-53f7c6a1-14e8-4145-b5ac-432eeb657dcd tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:52.908499 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-53f7c6a1-14e8-4145-b5ac-432eeb657dcd tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:52.908974 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-53f7c6a1-14e8-4145-b5ac-432eeb657dcd tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:53.044932 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-53f7c6a1-14e8-4145-b5ac-432eeb657dcd tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:53.052982 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-53f7c6a1-14e8-4145-b5ac-432eeb657dcd tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1557 microversion: 2.1 time: 0.156213 Oct 12 18:29:53.053559 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 334/658] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:52 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:53.103220 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-04eff55a-850f-40f1-a613-bcdaf12d055e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:53.103822 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-04eff55a-850f-40f1-a613-bcdaf12d055e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:53.109715 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-04eff55a-850f-40f1-a613-bcdaf12d055e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:53.110158 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-04eff55a-850f-40f1-a613-bcdaf12d055e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:53.110931 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-04eff55a-850f-40f1-a613-bcdaf12d055e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:53.111365 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-04eff55a-850f-40f1-a613-bcdaf12d055e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:53.240392 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-04eff55a-850f-40f1-a613-bcdaf12d055e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:53.248644 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-04eff55a-850f-40f1-a613-bcdaf12d055e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:53.250122 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-04eff55a-850f-40f1-a613-bcdaf12d055e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:53.251263 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-04eff55a-850f-40f1-a613-bcdaf12d055e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1807 microversion: 2.20 time: 0.152160 Oct 12 18:29:53.251819 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 325/659] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:53 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:29:54.070129 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-8713a46b-f947-4578-81ab-f3fa93722db0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:54.071160 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-8713a46b-f947-4578-81ab-f3fa93722db0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:54.077947 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8713a46b-f947-4578-81ab-f3fa93722db0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:54.078395 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8713a46b-f947-4578-81ab-f3fa93722db0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:54.079410 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8713a46b-f947-4578-81ab-f3fa93722db0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:54.080015 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8713a46b-f947-4578-81ab-f3fa93722db0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:54.206747 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-8713a46b-f947-4578-81ab-f3fa93722db0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:54.214338 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-8713a46b-f947-4578-81ab-f3fa93722db0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1557 microversion: 2.1 time: 0.148107 Oct 12 18:29:54.214903 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 335/660] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:54 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:54.270333 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-083294f8-57f0-42e3-8e9c-f6415cf09ec3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:54.270956 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-083294f8-57f0-42e3-8e9c-f6415cf09ec3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:54.276699 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-083294f8-57f0-42e3-8e9c-f6415cf09ec3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:54.277405 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-083294f8-57f0-42e3-8e9c-f6415cf09ec3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:54.278159 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-083294f8-57f0-42e3-8e9c-f6415cf09ec3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:54.278592 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-083294f8-57f0-42e3-8e9c-f6415cf09ec3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:54.643860 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-083294f8-57f0-42e3-8e9c-f6415cf09ec3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:54.651924 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-083294f8-57f0-42e3-8e9c-f6415cf09ec3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:54.653739 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-083294f8-57f0-42e3-8e9c-f6415cf09ec3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:54.654884 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-083294f8-57f0-42e3-8e9c-f6415cf09ec3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1807 microversion: 2.20 time: 0.388802 Oct 12 18:29:54.655436 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 326/661] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:54 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1807 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:29:55.232338 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-41179400-28fe-4165-a564-b27309f4502f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:55.232984 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-41179400-28fe-4165-a564-b27309f4502f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:55.239491 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-41179400-28fe-4165-a564-b27309f4502f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:55.239938 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-41179400-28fe-4165-a564-b27309f4502f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:55.240734 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-41179400-28fe-4165-a564-b27309f4502f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:55.241168 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-41179400-28fe-4165-a564-b27309f4502f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:55.369645 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-41179400-28fe-4165-a564-b27309f4502f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:55.377838 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-41179400-28fe-4165-a564-b27309f4502f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1557 microversion: 2.1 time: 0.149140 Oct 12 18:29:55.378449 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 336/662] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:55 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:55.671989 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ee50dafe-ba5f-46d9-9b49-43a17d3244fe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:55.672641 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ee50dafe-ba5f-46d9-9b49-43a17d3244fe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:55.678316 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ee50dafe-ba5f-46d9-9b49-43a17d3244fe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:55.678763 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ee50dafe-ba5f-46d9-9b49-43a17d3244fe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:55.679557 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ee50dafe-ba5f-46d9-9b49-43a17d3244fe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:55.679991 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ee50dafe-ba5f-46d9-9b49-43a17d3244fe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:55.806354 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ee50dafe-ba5f-46d9-9b49-43a17d3244fe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:55.817360 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ee50dafe-ba5f-46d9-9b49-43a17d3244fe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:55.818934 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ee50dafe-ba5f-46d9-9b49-43a17d3244fe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:55.820090 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ee50dafe-ba5f-46d9-9b49-43a17d3244fe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1807 microversion: 2.20 time: 0.151818 Oct 12 18:29:55.820711 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 327/663] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:55 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:29:56.394763 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-30980e5e-b4c7-49bf-ab9a-7cff48946ac4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:56.395307 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-30980e5e-b4c7-49bf-ab9a-7cff48946ac4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:56.401264 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-30980e5e-b4c7-49bf-ab9a-7cff48946ac4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:56.401702 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-30980e5e-b4c7-49bf-ab9a-7cff48946ac4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:56.402712 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-30980e5e-b4c7-49bf-ab9a-7cff48946ac4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:56.403133 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-30980e5e-b4c7-49bf-ab9a-7cff48946ac4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:56.535402 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-30980e5e-b4c7-49bf-ab9a-7cff48946ac4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:56.545339 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-30980e5e-b4c7-49bf-ab9a-7cff48946ac4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1557 microversion: 2.1 time: 0.154122 Oct 12 18:29:56.546613 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 337/664] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:56 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:56.839349 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8ca085cb-00a9-46bf-9968-51d3bb861bf3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:56.840522 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8ca085cb-00a9-46bf-9968-51d3bb861bf3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:56.848284 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8ca085cb-00a9-46bf-9968-51d3bb861bf3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:56.849059 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8ca085cb-00a9-46bf-9968-51d3bb861bf3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:56.849509 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8ca085cb-00a9-46bf-9968-51d3bb861bf3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:56.850758 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8ca085cb-00a9-46bf-9968-51d3bb861bf3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:56.980097 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8ca085cb-00a9-46bf-9968-51d3bb861bf3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:56.989916 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8ca085cb-00a9-46bf-9968-51d3bb861bf3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:56.991695 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8ca085cb-00a9-46bf-9968-51d3bb861bf3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:56.992984 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8ca085cb-00a9-46bf-9968-51d3bb861bf3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1807 microversion: 2.20 time: 0.158237 Oct 12 18:29:56.993771 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 328/665] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:56 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:29:57.563087 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-a8608a5c-d6d8-4cb6-9a4a-31aa947b7343 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:57.563707 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-a8608a5c-d6d8-4cb6-9a4a-31aa947b7343 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:57.569536 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a8608a5c-d6d8-4cb6-9a4a-31aa947b7343 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:57.569972 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a8608a5c-d6d8-4cb6-9a4a-31aa947b7343 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:57.570717 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a8608a5c-d6d8-4cb6-9a4a-31aa947b7343 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:57.571138 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a8608a5c-d6d8-4cb6-9a4a-31aa947b7343 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:57.701012 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-a8608a5c-d6d8-4cb6-9a4a-31aa947b7343 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:57.709374 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-a8608a5c-d6d8-4cb6-9a4a-31aa947b7343 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1557 microversion: 2.1 time: 0.149975 Oct 12 18:29:57.709946 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 338/666] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:57 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:58.011856 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f04f0237-0c24-4ef0-9fb9-852d17db6b94 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:58.012585 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f04f0237-0c24-4ef0-9fb9-852d17db6b94 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:58.018916 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f04f0237-0c24-4ef0-9fb9-852d17db6b94 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:58.019355 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f04f0237-0c24-4ef0-9fb9-852d17db6b94 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:58.020111 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f04f0237-0c24-4ef0-9fb9-852d17db6b94 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:58.020644 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f04f0237-0c24-4ef0-9fb9-852d17db6b94 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:58.149852 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f04f0237-0c24-4ef0-9fb9-852d17db6b94 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:58.158190 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f04f0237-0c24-4ef0-9fb9-852d17db6b94 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:58.159689 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f04f0237-0c24-4ef0-9fb9-852d17db6b94 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:58.160914 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f04f0237-0c24-4ef0-9fb9-852d17db6b94 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1807 microversion: 2.20 time: 0.152719 Oct 12 18:29:58.161476 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 329/667] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:58 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:29:58.727685 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-d36ed987-3352-4143-8c28-426f2bc33ad8 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:58.728869 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-d36ed987-3352-4143-8c28-426f2bc33ad8 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:58.735170 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d36ed987-3352-4143-8c28-426f2bc33ad8 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:58.735644 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d36ed987-3352-4143-8c28-426f2bc33ad8 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:58.736414 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d36ed987-3352-4143-8c28-426f2bc33ad8 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:58.737372 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d36ed987-3352-4143-8c28-426f2bc33ad8 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:58.861525 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-d36ed987-3352-4143-8c28-426f2bc33ad8 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:58.870273 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-d36ed987-3352-4143-8c28-426f2bc33ad8 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1557 microversion: 2.1 time: 0.146940 Oct 12 18:29:58.870844 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 339/668] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:58 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:29:59.179511 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-429fcf3c-1ffa-4a85-b97f-9a8b53830559 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:59.180210 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-429fcf3c-1ffa-4a85-b97f-9a8b53830559 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:59.186010 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-429fcf3c-1ffa-4a85-b97f-9a8b53830559 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:59.186456 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-429fcf3c-1ffa-4a85-b97f-9a8b53830559 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:59.187236 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-429fcf3c-1ffa-4a85-b97f-9a8b53830559 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:59.187667 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-429fcf3c-1ffa-4a85-b97f-9a8b53830559 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:59.312732 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-429fcf3c-1ffa-4a85-b97f-9a8b53830559 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:59.321474 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-429fcf3c-1ffa-4a85-b97f-9a8b53830559 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:59.322975 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-429fcf3c-1ffa-4a85-b97f-9a8b53830559 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:29:59.324129 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-429fcf3c-1ffa-4a85-b97f-9a8b53830559 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1807 microversion: 2.20 time: 0.148366 Oct 12 18:29:59.324739 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 330/669] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:29:59 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:29:59.887716 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-7354fa6d-8b79-4363-bda9-65d7964b65e8 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:29:59.888423 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-7354fa6d-8b79-4363-bda9-65d7964b65e8 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:29:59.895234 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7354fa6d-8b79-4363-bda9-65d7964b65e8 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:59.897699 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7354fa6d-8b79-4363-bda9-65d7964b65e8 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:29:59.897699 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7354fa6d-8b79-4363-bda9-65d7964b65e8 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:29:59.897699 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7354fa6d-8b79-4363-bda9-65d7964b65e8 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:00.029299 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-7354fa6d-8b79-4363-bda9-65d7964b65e8 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:00.037576 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-7354fa6d-8b79-4363-bda9-65d7964b65e8 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1557 microversion: 2.1 time: 0.153881 Oct 12 18:30:00.038146 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 340/670] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:29:59 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:00.342263 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2fffa7c4-0c2e-49f3-85bf-3dd5e8531f52 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:00.342886 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2fffa7c4-0c2e-49f3-85bf-3dd5e8531f52 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:00.348699 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2fffa7c4-0c2e-49f3-85bf-3dd5e8531f52 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:00.349150 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2fffa7c4-0c2e-49f3-85bf-3dd5e8531f52 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:00.349926 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2fffa7c4-0c2e-49f3-85bf-3dd5e8531f52 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:00.350374 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2fffa7c4-0c2e-49f3-85bf-3dd5e8531f52 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:00.479541 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2fffa7c4-0c2e-49f3-85bf-3dd5e8531f52 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:00.488106 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2fffa7c4-0c2e-49f3-85bf-3dd5e8531f52 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:00.489630 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2fffa7c4-0c2e-49f3-85bf-3dd5e8531f52 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:00.490780 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2fffa7c4-0c2e-49f3-85bf-3dd5e8531f52 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1807 microversion: 2.20 time: 0.152294 Oct 12 18:30:00.491342 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 331/671] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:30:00 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:30:01.054316 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-cd72d475-9556-4a5e-ac38-b671f5433cd1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:01.054950 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-cd72d475-9556-4a5e-ac38-b671f5433cd1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:01.060830 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cd72d475-9556-4a5e-ac38-b671f5433cd1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:01.061282 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cd72d475-9556-4a5e-ac38-b671f5433cd1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:01.062038 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cd72d475-9556-4a5e-ac38-b671f5433cd1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:01.062472 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cd72d475-9556-4a5e-ac38-b671f5433cd1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:01.187859 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-cd72d475-9556-4a5e-ac38-b671f5433cd1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:01.196081 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-cd72d475-9556-4a5e-ac38-b671f5433cd1 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1557 microversion: 2.1 time: 0.145498 Oct 12 18:30:01.196747 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 341/672] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:01 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:01.510134 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b8caa998-0e8e-49ca-953f-be5514d2d06f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:01.510868 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b8caa998-0e8e-49ca-953f-be5514d2d06f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:01.516792 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b8caa998-0e8e-49ca-953f-be5514d2d06f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:01.517231 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b8caa998-0e8e-49ca-953f-be5514d2d06f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:01.517992 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b8caa998-0e8e-49ca-953f-be5514d2d06f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:01.518415 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b8caa998-0e8e-49ca-953f-be5514d2d06f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:01.651969 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b8caa998-0e8e-49ca-953f-be5514d2d06f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:01.661054 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b8caa998-0e8e-49ca-953f-be5514d2d06f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:01.662579 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b8caa998-0e8e-49ca-953f-be5514d2d06f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:01.663831 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b8caa998-0e8e-49ca-953f-be5514d2d06f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1807 microversion: 2.20 time: 0.158106 Oct 12 18:30:01.664415 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 332/673] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:30:01 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:30:02.213504 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-e82efe48-f314-400e-9f1e-2e4f0bb3fce0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:02.214135 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-e82efe48-f314-400e-9f1e-2e4f0bb3fce0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:02.224242 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e82efe48-f314-400e-9f1e-2e4f0bb3fce0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:02.224777 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e82efe48-f314-400e-9f1e-2e4f0bb3fce0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:02.225532 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e82efe48-f314-400e-9f1e-2e4f0bb3fce0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:02.225962 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e82efe48-f314-400e-9f1e-2e4f0bb3fce0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:02.351326 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-e82efe48-f314-400e-9f1e-2e4f0bb3fce0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:02.359283 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-e82efe48-f314-400e-9f1e-2e4f0bb3fce0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1557 microversion: 2.1 time: 0.149376 Oct 12 18:30:02.359858 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 342/674] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:02 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:02.683227 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-eaba0765-9d4c-4891-ba8d-165a04d921df tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:02.683819 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-eaba0765-9d4c-4891-ba8d-165a04d921df tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:02.689813 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eaba0765-9d4c-4891-ba8d-165a04d921df tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:02.692545 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eaba0765-9d4c-4891-ba8d-165a04d921df tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:02.692545 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eaba0765-9d4c-4891-ba8d-165a04d921df tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:02.692545 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eaba0765-9d4c-4891-ba8d-165a04d921df tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:02.819284 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-eaba0765-9d4c-4891-ba8d-165a04d921df tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:02.827569 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-eaba0765-9d4c-4891-ba8d-165a04d921df tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:02.829081 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-eaba0765-9d4c-4891-ba8d-165a04d921df tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:02.830235 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-eaba0765-9d4c-4891-ba8d-165a04d921df tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1807 microversion: 2.20 time: 0.150950 Oct 12 18:30:02.830834 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 333/675] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:30:02 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:30:03.376349 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-b1fe6dc9-3564-486b-adb8-184b06ed3415 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:03.376979 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-b1fe6dc9-3564-486b-adb8-184b06ed3415 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:03.383462 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b1fe6dc9-3564-486b-adb8-184b06ed3415 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:03.383910 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b1fe6dc9-3564-486b-adb8-184b06ed3415 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:03.384750 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b1fe6dc9-3564-486b-adb8-184b06ed3415 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:03.385162 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b1fe6dc9-3564-486b-adb8-184b06ed3415 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:03.507211 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-b1fe6dc9-3564-486b-adb8-184b06ed3415 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:03.514895 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-b1fe6dc9-3564-486b-adb8-184b06ed3415 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1557 microversion: 2.1 time: 0.142191 Oct 12 18:30:03.515464 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 343/676] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:03 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1557 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:03.847949 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-dd5da718-4438-4697-8ff3-7cd8ef0f33f1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:03.848587 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-dd5da718-4438-4697-8ff3-7cd8ef0f33f1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:03.856013 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dd5da718-4438-4697-8ff3-7cd8ef0f33f1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:03.856637 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dd5da718-4438-4697-8ff3-7cd8ef0f33f1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:03.857283 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dd5da718-4438-4697-8ff3-7cd8ef0f33f1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:03.857727 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dd5da718-4438-4697-8ff3-7cd8ef0f33f1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:03.977258 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-dd5da718-4438-4697-8ff3-7cd8ef0f33f1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:03.986235 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-dd5da718-4438-4697-8ff3-7cd8ef0f33f1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:03.988367 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-dd5da718-4438-4697-8ff3-7cd8ef0f33f1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:03.989615 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-dd5da718-4438-4697-8ff3-7cd8ef0f33f1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1807 microversion: 2.20 time: 0.145339 Oct 12 18:30:03.990228 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 334/677] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:30:03 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1807 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:30:04.532304 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-226166b3-2b10-4736-b893-eca0e3a40e46 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:04.533029 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-226166b3-2b10-4736-b893-eca0e3a40e46 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:04.539448 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-226166b3-2b10-4736-b893-eca0e3a40e46 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:04.539896 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-226166b3-2b10-4736-b893-eca0e3a40e46 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:04.540691 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-226166b3-2b10-4736-b893-eca0e3a40e46 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:04.541125 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-226166b3-2b10-4736-b893-eca0e3a40e46 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:04.660995 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-226166b3-2b10-4736-b893-eca0e3a40e46 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:04.668662 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-226166b3-2b10-4736-b893-eca0e3a40e46 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1557 microversion: 2.1 time: 0.139946 Oct 12 18:30:04.669225 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 344/678] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:04 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1557 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:05.007953 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c003e107-7c76-4c39-8cb2-26529db07ca9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:05.008586 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c003e107-7c76-4c39-8cb2-26529db07ca9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:05.014326 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c003e107-7c76-4c39-8cb2-26529db07ca9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:05.014765 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c003e107-7c76-4c39-8cb2-26529db07ca9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:05.015520 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c003e107-7c76-4c39-8cb2-26529db07ca9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:05.015946 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c003e107-7c76-4c39-8cb2-26529db07ca9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:05.138990 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c003e107-7c76-4c39-8cb2-26529db07ca9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:05.147701 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c003e107-7c76-4c39-8cb2-26529db07ca9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:05.149227 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c003e107-7c76-4c39-8cb2-26529db07ca9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:05.150362 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c003e107-7c76-4c39-8cb2-26529db07ca9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1807 microversion: 2.20 time: 0.146094 Oct 12 18:30:05.150912 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 335/679] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:30:05 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1807 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:30:05.685189 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-db688e6c-922e-47f8-81d4-218ff62192a5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:05.687208 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-db688e6c-922e-47f8-81d4-218ff62192a5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:05.691641 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-db688e6c-922e-47f8-81d4-218ff62192a5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:05.692080 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-db688e6c-922e-47f8-81d4-218ff62192a5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:05.692866 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-db688e6c-922e-47f8-81d4-218ff62192a5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:05.693290 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-db688e6c-922e-47f8-81d4-218ff62192a5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:05.812886 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-db688e6c-922e-47f8-81d4-218ff62192a5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:05.820591 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-db688e6c-922e-47f8-81d4-218ff62192a5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1557 microversion: 2.1 time: 0.139187 Oct 12 18:30:05.821156 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 345/680] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:05 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1557 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:06.168476 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-efd1e764-495f-4df9-9b26-f99cb7405444 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:06.169090 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-efd1e764-495f-4df9-9b26-f99cb7405444 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:06.174971 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-efd1e764-495f-4df9-9b26-f99cb7405444 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:06.175411 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-efd1e764-495f-4df9-9b26-f99cb7405444 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:06.176170 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-efd1e764-495f-4df9-9b26-f99cb7405444 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:06.176633 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-efd1e764-495f-4df9-9b26-f99cb7405444 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:06.324197 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-efd1e764-495f-4df9-9b26-f99cb7405444 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:06.333151 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-efd1e764-495f-4df9-9b26-f99cb7405444 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:06.334663 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-efd1e764-495f-4df9-9b26-f99cb7405444 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:06.335800 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-efd1e764-495f-4df9-9b26-f99cb7405444 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1807 microversion: 2.20 time: 0.171056 Oct 12 18:30:06.336355 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 336/681] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:30:06 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:30:06.836845 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c91abcdf-0602-4978-b7b3-4171361838b4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:06.837477 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c91abcdf-0602-4978-b7b3-4171361838b4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:06.847940 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c91abcdf-0602-4978-b7b3-4171361838b4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:06.847940 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c91abcdf-0602-4978-b7b3-4171361838b4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:06.847940 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c91abcdf-0602-4978-b7b3-4171361838b4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:06.847940 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c91abcdf-0602-4978-b7b3-4171361838b4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:06.969040 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c91abcdf-0602-4978-b7b3-4171361838b4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:06.976697 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c91abcdf-0602-4978-b7b3-4171361838b4 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1557 microversion: 2.1 time: 0.143442 Oct 12 18:30:06.977508 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 346/682] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:06 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1557 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:30:07.353816 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-175f8322-4f92-4326-aa8c-42eae26fb7e4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:07.354410 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-175f8322-4f92-4326-aa8c-42eae26fb7e4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:07.360191 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-175f8322-4f92-4326-aa8c-42eae26fb7e4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:07.360658 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-175f8322-4f92-4326-aa8c-42eae26fb7e4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:07.361488 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-175f8322-4f92-4326-aa8c-42eae26fb7e4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:07.362455 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-175f8322-4f92-4326-aa8c-42eae26fb7e4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:07.480567 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-175f8322-4f92-4326-aa8c-42eae26fb7e4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:07.488805 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-175f8322-4f92-4326-aa8c-42eae26fb7e4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:07.490274 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-175f8322-4f92-4326-aa8c-42eae26fb7e4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:07.491408 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-175f8322-4f92-4326-aa8c-42eae26fb7e4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1807 microversion: 2.20 time: 0.141287 Oct 12 18:30:07.491956 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 337/683] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:30:07 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1807 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:30:07.994033 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-fc0d4060-02a3-4e81-a2f8-f07e7efcdfb7 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:07.994648 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-fc0d4060-02a3-4e81-a2f8-f07e7efcdfb7 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:08.000992 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fc0d4060-02a3-4e81-a2f8-f07e7efcdfb7 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:08.001436 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fc0d4060-02a3-4e81-a2f8-f07e7efcdfb7 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:08.002727 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fc0d4060-02a3-4e81-a2f8-f07e7efcdfb7 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:08.003151 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fc0d4060-02a3-4e81-a2f8-f07e7efcdfb7 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:08.124117 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-fc0d4060-02a3-4e81-a2f8-f07e7efcdfb7 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:08.132384 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-fc0d4060-02a3-4e81-a2f8-f07e7efcdfb7 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1557 microversion: 2.1 time: 0.142243 Oct 12 18:30:08.136088 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 347/684] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:07 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1557 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:08.509147 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-cb1f9640-1c93-4a1b-95f3-15a7e5d6f87d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:08.509744 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-cb1f9640-1c93-4a1b-95f3-15a7e5d6f87d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:08.515487 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cb1f9640-1c93-4a1b-95f3-15a7e5d6f87d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:08.515924 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cb1f9640-1c93-4a1b-95f3-15a7e5d6f87d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:08.516710 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cb1f9640-1c93-4a1b-95f3-15a7e5d6f87d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:08.517133 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cb1f9640-1c93-4a1b-95f3-15a7e5d6f87d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:08.641551 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-cb1f9640-1c93-4a1b-95f3-15a7e5d6f87d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:08.649922 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-cb1f9640-1c93-4a1b-95f3-15a7e5d6f87d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:08.651455 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-cb1f9640-1c93-4a1b-95f3-15a7e5d6f87d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:08.653149 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-cb1f9640-1c93-4a1b-95f3-15a7e5d6f87d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1807 microversion: 2.20 time: 0.147659 Oct 12 18:30:08.653744 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 338/685] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:30:08 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1807 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:30:09.149366 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-2832f41b-d9c9-41a2-9e0f-2ee2632fd681 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:09.149963 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-2832f41b-d9c9-41a2-9e0f-2ee2632fd681 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:09.155946 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2832f41b-d9c9-41a2-9e0f-2ee2632fd681 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:09.156389 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2832f41b-d9c9-41a2-9e0f-2ee2632fd681 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:09.157172 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2832f41b-d9c9-41a2-9e0f-2ee2632fd681 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:09.157602 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2832f41b-d9c9-41a2-9e0f-2ee2632fd681 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:09.288657 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-2832f41b-d9c9-41a2-9e0f-2ee2632fd681 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:09.297089 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-2832f41b-d9c9-41a2-9e0f-2ee2632fd681 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1557 microversion: 2.1 time: 0.151313 Oct 12 18:30:09.297662 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 348/686] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:09 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:09.672843 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9ae2f923-23fa-4690-8544-152a819a3119 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:09.673511 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9ae2f923-23fa-4690-8544-152a819a3119 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:09.680186 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9ae2f923-23fa-4690-8544-152a819a3119 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:09.680651 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9ae2f923-23fa-4690-8544-152a819a3119 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:09.681460 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9ae2f923-23fa-4690-8544-152a819a3119 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:09.681888 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9ae2f923-23fa-4690-8544-152a819a3119 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:09.803469 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9ae2f923-23fa-4690-8544-152a819a3119 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:09.812182 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9ae2f923-23fa-4690-8544-152a819a3119 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:09.813688 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9ae2f923-23fa-4690-8544-152a819a3119 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:09.815454 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9ae2f923-23fa-4690-8544-152a819a3119 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1807 microversion: 2.20 time: 0.146361 Oct 12 18:30:09.816026 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 339/687] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:30:09 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1807 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:30:10.315668 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-673727c3-f253-4b86-9b5f-66c34e77b3de tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:10.316220 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-673727c3-f253-4b86-9b5f-66c34e77b3de tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:10.322021 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-673727c3-f253-4b86-9b5f-66c34e77b3de tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:10.322461 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-673727c3-f253-4b86-9b5f-66c34e77b3de tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:10.323211 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-673727c3-f253-4b86-9b5f-66c34e77b3de tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:10.323636 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-673727c3-f253-4b86-9b5f-66c34e77b3de tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:10.448111 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-673727c3-f253-4b86-9b5f-66c34e77b3de tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:10.455765 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-673727c3-f253-4b86-9b5f-66c34e77b3de tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1563 microversion: 2.1 time: 0.144318 Oct 12 18:30:10.456328 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 349/688] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:10 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1563 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:30:10.521284 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a197c2f2-4e59-4e15-be84-85c7161d26cb tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:10.521788 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a197c2f2-4e59-4e15-be84-85c7161d26cb tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:10.527682 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a197c2f2-4e59-4e15-be84-85c7161d26cb tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:10.528124 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a197c2f2-4e59-4e15-be84-85c7161d26cb tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:10.528911 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a197c2f2-4e59-4e15-be84-85c7161d26cb tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:10.529339 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a197c2f2-4e59-4e15-be84-85c7161d26cb tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:10.651195 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-a197c2f2-4e59-4e15-be84-85c7161d26cb tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lazy-loading 'services' on Instance uuid 4ade368f-e898-4346-83a8-3d3eb86c8192 {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:30:10.836708 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-6fb8c8f7-d70b-46d2-96d9-1c441927ce08 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:10.837304 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-6fb8c8f7-d70b-46d2-96d9-1c441927ce08 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:10.843165 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6fb8c8f7-d70b-46d2-96d9-1c441927ce08 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:10.843600 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6fb8c8f7-d70b-46d2-96d9-1c441927ce08 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:10.844351 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6fb8c8f7-d70b-46d2-96d9-1c441927ce08 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:10.844810 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6fb8c8f7-d70b-46d2-96d9-1c441927ce08 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:10.957163 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a197c2f2-4e59-4e15-be84-85c7161d26cb tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192/os-volume_attachments/d5731d78-ed20-43fb-8946-44d58a6d0c98" status: 202 len: 0 microversion: 2.1 time: 0.438715 Oct 12 18:30:10.960791 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 340/689] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Oct 12 18:30:10 2021] DELETE /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192/os-volume_attachments/d5731d78-ed20-43fb-8946-44d58a6d0c98 => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:30:10.966412 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-cf2a660e-39ce-41f8-b530-235fda351f51 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:10.967517 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-cf2a660e-39ce-41f8-b530-235fda351f51 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:10.973643 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-6fb8c8f7-d70b-46d2-96d9-1c441927ce08 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:10.977293 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cf2a660e-39ce-41f8-b530-235fda351f51 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:10.977900 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cf2a660e-39ce-41f8-b530-235fda351f51 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:10.978945 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cf2a660e-39ce-41f8-b530-235fda351f51 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:10.979495 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cf2a660e-39ce-41f8-b530-235fda351f51 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:10.985461 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-6fb8c8f7-d70b-46d2-96d9-1c441927ce08 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:10.989366 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-6fb8c8f7-d70b-46d2-96d9-1c441927ce08 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:10.989773 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-6fb8c8f7-d70b-46d2-96d9-1c441927ce08 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1807 microversion: 2.20 time: 0.156528 Oct 12 18:30:10.990771 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 350/690] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:30:10 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:30:11.015797 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-cf2a660e-39ce-41f8-b530-235fda351f51 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053520 Oct 12 18:30:11.016346 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 341/691] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Oct 12 18:30:10 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:30:12.010342 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-06f7be69-6233-42a9-a3b2-662bbf3b9181 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:12.010943 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-06f7be69-6233-42a9-a3b2-662bbf3b9181 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:12.016956 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-06f7be69-6233-42a9-a3b2-662bbf3b9181 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:12.017430 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-06f7be69-6233-42a9-a3b2-662bbf3b9181 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:12.018178 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-06f7be69-6233-42a9-a3b2-662bbf3b9181 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:12.018602 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-06f7be69-6233-42a9-a3b2-662bbf3b9181 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:12.026858 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f31f424a-9b15-48c0-b732-abb40e446ead tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:12.028052 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f31f424a-9b15-48c0-b732-abb40e446ead tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:12.033967 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f31f424a-9b15-48c0-b732-abb40e446ead tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:12.034418 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f31f424a-9b15-48c0-b732-abb40e446ead tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:12.035198 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f31f424a-9b15-48c0-b732-abb40e446ead tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:12.035626 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f31f424a-9b15-48c0-b732-abb40e446ead tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:12.066602 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f31f424a-9b15-48c0-b732-abb40e446ead tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043424 Oct 12 18:30:12.075964 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 342/692] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Oct 12 18:30:12 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 18:30:12.141521 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-06f7be69-6233-42a9-a3b2-662bbf3b9181 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:12.149912 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-06f7be69-6233-42a9-a3b2-662bbf3b9181 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:12.151401 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-06f7be69-6233-42a9-a3b2-662bbf3b9181 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:12.152922 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-06f7be69-6233-42a9-a3b2-662bbf3b9181 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1807 microversion: 2.20 time: 0.146241 Oct 12 18:30:12.153406 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 351/693] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:30:12 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1807 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:30:13.078213 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3336502b-0b7a-4f75-be37-8fe542ab4f29 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:13.079242 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3336502b-0b7a-4f75-be37-8fe542ab4f29 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:13.085143 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3336502b-0b7a-4f75-be37-8fe542ab4f29 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:13.085585 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3336502b-0b7a-4f75-be37-8fe542ab4f29 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:13.086350 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3336502b-0b7a-4f75-be37-8fe542ab4f29 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:13.086773 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3336502b-0b7a-4f75-be37-8fe542ab4f29 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:13.115731 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3336502b-0b7a-4f75-be37-8fe542ab4f29 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041379 Oct 12 18:30:13.116291 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 343/694] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Oct 12 18:30:13 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 18:30:13.170731 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-42dca35e-1a0b-4951-8e0b-062fba8b4ecb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:13.171334 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-42dca35e-1a0b-4951-8e0b-062fba8b4ecb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:13.178977 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-42dca35e-1a0b-4951-8e0b-062fba8b4ecb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:13.179419 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-42dca35e-1a0b-4951-8e0b-062fba8b4ecb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:13.180222 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-42dca35e-1a0b-4951-8e0b-062fba8b4ecb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:13.181072 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-42dca35e-1a0b-4951-8e0b-062fba8b4ecb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:13.307886 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-42dca35e-1a0b-4951-8e0b-062fba8b4ecb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:13.316081 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-42dca35e-1a0b-4951-8e0b-062fba8b4ecb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:13.317624 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-42dca35e-1a0b-4951-8e0b-062fba8b4ecb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:13.318774 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-42dca35e-1a0b-4951-8e0b-062fba8b4ecb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1807 microversion: 2.20 time: 0.151719 Oct 12 18:30:13.319326 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 352/695] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:30:13 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:30:14.337693 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8aee4b2b-9ee2-42bc-94a1-f8746b377cdc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:14.338700 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8aee4b2b-9ee2-42bc-94a1-f8746b377cdc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:14.344300 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8aee4b2b-9ee2-42bc-94a1-f8746b377cdc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:14.344769 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8aee4b2b-9ee2-42bc-94a1-f8746b377cdc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:14.345552 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8aee4b2b-9ee2-42bc-94a1-f8746b377cdc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:14.345974 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8aee4b2b-9ee2-42bc-94a1-f8746b377cdc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:14.466889 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8aee4b2b-9ee2-42bc-94a1-f8746b377cdc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:14.475226 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8aee4b2b-9ee2-42bc-94a1-f8746b377cdc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:14.476736 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8aee4b2b-9ee2-42bc-94a1-f8746b377cdc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:14.477893 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8aee4b2b-9ee2-42bc-94a1-f8746b377cdc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1807 microversion: 2.20 time: 0.144579 Oct 12 18:30:14.478440 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 344/696] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:30:14 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1807 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:30:15.496668 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-358ec4dd-792c-450a-ba56-185cbdd41aea tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:15.497276 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-358ec4dd-792c-450a-ba56-185cbdd41aea tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:15.503596 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-358ec4dd-792c-450a-ba56-185cbdd41aea tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:15.504071 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-358ec4dd-792c-450a-ba56-185cbdd41aea tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:15.504863 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-358ec4dd-792c-450a-ba56-185cbdd41aea tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:15.505295 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-358ec4dd-792c-450a-ba56-185cbdd41aea tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:15.623602 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-358ec4dd-792c-450a-ba56-185cbdd41aea tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:15.632490 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-358ec4dd-792c-450a-ba56-185cbdd41aea tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:15.633978 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-358ec4dd-792c-450a-ba56-185cbdd41aea tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:15.635116 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-358ec4dd-792c-450a-ba56-185cbdd41aea tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1807 microversion: 2.20 time: 0.142170 Oct 12 18:30:15.635669 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 353/697] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:30:15 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1807 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:30:15.778461 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4b39dcbd-3cfe-46bf-8731-6d8ab01ad90c tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:15.778957 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4b39dcbd-3cfe-46bf-8731-6d8ab01ad90c tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:15.784761 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4b39dcbd-3cfe-46bf-8731-6d8ab01ad90c tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:15.785199 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4b39dcbd-3cfe-46bf-8731-6d8ab01ad90c tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:15.785952 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4b39dcbd-3cfe-46bf-8731-6d8ab01ad90c tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:15.786377 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4b39dcbd-3cfe-46bf-8731-6d8ab01ad90c tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:15.811232 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4b39dcbd-3cfe-46bf-8731-6d8ab01ad90c tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Going to try to terminate instance {{(pid=109168) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 18:30:16.127777 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4b39dcbd-3cfe-46bf-8731-6d8ab01ad90c tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "DELETE /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 204 len: 0 microversion: 2.1 time: 0.353260 Oct 12 18:30:16.128435 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 345/698] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Oct 12 18:30:15 2021] DELETE /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 18:30:16.136452 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-f053960f-4e9f-4fd1-a1b6-7738f3f5ab2d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:16.137162 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-f053960f-4e9f-4fd1-a1b6-7738f3f5ab2d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:16.143346 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f053960f-4e9f-4fd1-a1b6-7738f3f5ab2d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:16.144436 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f053960f-4e9f-4fd1-a1b6-7738f3f5ab2d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:16.145333 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f053960f-4e9f-4fd1-a1b6-7738f3f5ab2d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:16.145773 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f053960f-4e9f-4fd1-a1b6-7738f3f5ab2d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:16.269891 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-f053960f-4e9f-4fd1-a1b6-7738f3f5ab2d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:16.277459 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-f053960f-4e9f-4fd1-a1b6-7738f3f5ab2d tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1508 microversion: 2.1 time: 0.144643 Oct 12 18:30:16.278030 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 354/699] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:16 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1508 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:16.654431 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1738cfb4-511a-496d-a21a-e248b687209a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:16.655115 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1738cfb4-511a-496d-a21a-e248b687209a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:16.661520 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1738cfb4-511a-496d-a21a-e248b687209a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:16.661890 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1738cfb4-511a-496d-a21a-e248b687209a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:16.662642 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1738cfb4-511a-496d-a21a-e248b687209a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:16.663062 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1738cfb4-511a-496d-a21a-e248b687209a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:16.782781 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1738cfb4-511a-496d-a21a-e248b687209a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:16.791200 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1738cfb4-511a-496d-a21a-e248b687209a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:16.792708 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1738cfb4-511a-496d-a21a-e248b687209a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:16.793856 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1738cfb4-511a-496d-a21a-e248b687209a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1807 microversion: 2.20 time: 0.143716 Oct 12 18:30:16.794411 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 346/700] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:30:16 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1807 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:30:17.294901 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-85bbeff3-f40a-4553-ad3a-25d8e9e1648e tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:17.295508 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-85bbeff3-f40a-4553-ad3a-25d8e9e1648e tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:17.301834 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-85bbeff3-f40a-4553-ad3a-25d8e9e1648e tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:17.302275 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-85bbeff3-f40a-4553-ad3a-25d8e9e1648e tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:17.303035 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-85bbeff3-f40a-4553-ad3a-25d8e9e1648e tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:17.303465 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-85bbeff3-f40a-4553-ad3a-25d8e9e1648e tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:17.423255 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-85bbeff3-f40a-4553-ad3a-25d8e9e1648e tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:17.431024 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-85bbeff3-f40a-4553-ad3a-25d8e9e1648e tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1508 microversion: 2.1 time: 0.139819 Oct 12 18:30:17.431582 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 355/701] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:17 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1508 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:17.811824 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5f8cd2c7-bbab-449b-9a4a-0054ef600705 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:17.812808 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5f8cd2c7-bbab-449b-9a4a-0054ef600705 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:17.818484 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5f8cd2c7-bbab-449b-9a4a-0054ef600705 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:17.818925 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5f8cd2c7-bbab-449b-9a4a-0054ef600705 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:17.819688 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5f8cd2c7-bbab-449b-9a4a-0054ef600705 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:17.820118 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5f8cd2c7-bbab-449b-9a4a-0054ef600705 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:17.943754 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5f8cd2c7-bbab-449b-9a4a-0054ef600705 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:17.951833 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5f8cd2c7-bbab-449b-9a4a-0054ef600705 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:17.953377 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5f8cd2c7-bbab-449b-9a4a-0054ef600705 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:17.954523 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5f8cd2c7-bbab-449b-9a4a-0054ef600705 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1807 microversion: 2.20 time: 0.146331 Oct 12 18:30:17.955586 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 347/702] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:30:17 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1807 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:30:18.448488 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-6800c362-e4ec-4f85-9082-9a41f02acced tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:18.449097 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-6800c362-e4ec-4f85-9082-9a41f02acced tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:18.455563 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6800c362-e4ec-4f85-9082-9a41f02acced tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:18.455965 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6800c362-e4ec-4f85-9082-9a41f02acced tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:18.456744 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6800c362-e4ec-4f85-9082-9a41f02acced tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:18.457173 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6800c362-e4ec-4f85-9082-9a41f02acced tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:18.594710 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-6800c362-e4ec-4f85-9082-9a41f02acced tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:18.602862 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-6800c362-e4ec-4f85-9082-9a41f02acced tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1508 microversion: 2.1 time: 0.158063 Oct 12 18:30:18.604547 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 356/703] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:18 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:18.974951 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5768f326-ea3d-4a16-99cd-dbc87f840cc9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:18.976067 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5768f326-ea3d-4a16-99cd-dbc87f840cc9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:18.981901 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5768f326-ea3d-4a16-99cd-dbc87f840cc9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:18.982342 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5768f326-ea3d-4a16-99cd-dbc87f840cc9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:18.983113 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5768f326-ea3d-4a16-99cd-dbc87f840cc9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:18.983539 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5768f326-ea3d-4a16-99cd-dbc87f840cc9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:18.995362 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-91093785-fd1d-40ce-b47d-3083ec92cdb8 req-1eabdab3-52a6-4fb5-8102-a1a0ec686a68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a13e5623-9ecd-4036-b74a-48cbb84908de", "name": "network-vif-plugged", "status": "completed", "tag": "fabaeaf5-eee4-46bf-a4bf-984ef9955b1e"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:30:18.998574 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:30:18.998574 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:30:19.009594 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-91093785-fd1d-40ce-b47d-3083ec92cdb8 req-1eabdab3-52a6-4fb5-8102-a1a0ec686a68 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:19.010507 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-91093785-fd1d-40ce-b47d-3083ec92cdb8 req-1eabdab3-52a6-4fb5-8102-a1a0ec686a68 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:19.022140 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-91093785-fd1d-40ce-b47d-3083ec92cdb8 req-1eabdab3-52a6-4fb5-8102-a1a0ec686a68 service nova] Creating event network-vif-plugged:fabaeaf5-eee4-46bf-a4bf-984ef9955b1e for instance a13e5623-9ecd-4036-b74a-48cbb84908de on hv-cinder-81322 Oct 12 18:30:19.027504 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-91093785-fd1d-40ce-b47d-3083ec92cdb8 req-1eabdab3-52a6-4fb5-8102-a1a0ec686a68 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035590 Oct 12 18:30:19.028096 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 357/704] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:30:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:30:19.198907 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5768f326-ea3d-4a16-99cd-dbc87f840cc9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:19.207142 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5768f326-ea3d-4a16-99cd-dbc87f840cc9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:19.208673 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5768f326-ea3d-4a16-99cd-dbc87f840cc9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:19.209829 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5768f326-ea3d-4a16-99cd-dbc87f840cc9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1807 microversion: 2.20 time: 0.239304 Oct 12 18:30:19.210399 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 348/705] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:30:18 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1807 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:30:19.443402 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-84031e19-1a5c-4d7f-99b9-9801c4836fa7 req-301c06ae-d655-4b8c-bff9-2864f44af7b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40b9689f-c878-4777-b81b-976434249834", "name": "network-vif-deleted", "tag": "28d1dc71-8166-49a5-a37e-6d2062224b4a"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:30:19.444892 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:30:19.444892 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:30:19.452334 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-84031e19-1a5c-4d7f-99b9-9801c4836fa7 req-301c06ae-d655-4b8c-bff9-2864f44af7b7 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:19.453039 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-84031e19-1a5c-4d7f-99b9-9801c4836fa7 req-301c06ae-d655-4b8c-bff9-2864f44af7b7 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:19.464925 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-84031e19-1a5c-4d7f-99b9-9801c4836fa7 req-301c06ae-d655-4b8c-bff9-2864f44af7b7 service nova] Creating event network-vif-deleted:28d1dc71-8166-49a5-a37e-6d2062224b4a for instance 40b9689f-c878-4777-b81b-976434249834 on hv-cinder-81322 Oct 12 18:30:19.470163 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-84031e19-1a5c-4d7f-99b9-9801c4836fa7 req-301c06ae-d655-4b8c-bff9-2864f44af7b7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030686 Oct 12 18:30:19.471504 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 358/706] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:30:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:30:19.621076 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9b217622-bc5d-479d-8dbe-d27a352641e9 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:19.621685 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9b217622-bc5d-479d-8dbe-d27a352641e9 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:19.627568 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9b217622-bc5d-479d-8dbe-d27a352641e9 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:19.628015 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9b217622-bc5d-479d-8dbe-d27a352641e9 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:19.629112 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9b217622-bc5d-479d-8dbe-d27a352641e9 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:19.629753 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9b217622-bc5d-479d-8dbe-d27a352641e9 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:19.711616 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9b217622-bc5d-479d-8dbe-d27a352641e9 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:19.718756 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9b217622-bc5d-479d-8dbe-d27a352641e9 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1293 microversion: 2.1 time: 0.101202 Oct 12 18:30:19.719401 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 349/707] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:19 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1293 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:20.229382 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-573b010d-4730-4527-9fca-179ed646283f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:20.230073 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-573b010d-4730-4527-9fca-179ed646283f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:20.236733 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-573b010d-4730-4527-9fca-179ed646283f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:20.237173 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-573b010d-4730-4527-9fca-179ed646283f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:20.237935 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-573b010d-4730-4527-9fca-179ed646283f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:20.238364 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-573b010d-4730-4527-9fca-179ed646283f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:20.378214 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-573b010d-4730-4527-9fca-179ed646283f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:20.386416 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-573b010d-4730-4527-9fca-179ed646283f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:20.387962 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-573b010d-4730-4527-9fca-179ed646283f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:20.389078 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-573b010d-4730-4527-9fca-179ed646283f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1807 microversion: 2.20 time: 0.163867 Oct 12 18:30:20.389631 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 359/708] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:30:20 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:30:20.738310 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f07f6ed2-f3bc-4897-a580-6803d656a5e6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:20.738917 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f07f6ed2-f3bc-4897-a580-6803d656a5e6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:20.745102 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f07f6ed2-f3bc-4897-a580-6803d656a5e6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:20.745579 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f07f6ed2-f3bc-4897-a580-6803d656a5e6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:20.746368 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f07f6ed2-f3bc-4897-a580-6803d656a5e6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:20.746836 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f07f6ed2-f3bc-4897-a580-6803d656a5e6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:20.780169 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f07f6ed2-f3bc-4897-a580-6803d656a5e6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:20.780754 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f07f6ed2-f3bc-4897-a580-6803d656a5e6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:20.781215 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-f07f6ed2-f3bc-4897-a580-6803d656a5e6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lazy-loading 'fault' on Instance uuid 40b9689f-c878-4777-b81b-976434249834 {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:30:20.821322 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f07f6ed2-f3bc-4897-a580-6803d656a5e6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:20.828773 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f07f6ed2-f3bc-4897-a580-6803d656a5e6 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 200 len: 1312 microversion: 2.1 time: 0.094659 Oct 12 18:30:20.829344 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 350/709] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:20 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:21.407237 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-9a488aec-b295-456e-8950-5e3ef542c68b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:21.407892 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-9a488aec-b295-456e-8950-5e3ef542c68b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:21.413709 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9a488aec-b295-456e-8950-5e3ef542c68b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:21.414152 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9a488aec-b295-456e-8950-5e3ef542c68b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:21.414918 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9a488aec-b295-456e-8950-5e3ef542c68b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:21.415347 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9a488aec-b295-456e-8950-5e3ef542c68b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:21.541634 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-9a488aec-b295-456e-8950-5e3ef542c68b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:21.550057 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-9a488aec-b295-456e-8950-5e3ef542c68b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:21.551521 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-9a488aec-b295-456e-8950-5e3ef542c68b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:21.552692 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-9a488aec-b295-456e-8950-5e3ef542c68b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1807 microversion: 2.20 time: 0.149097 Oct 12 18:30:21.553254 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 360/710] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:30:21 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:30:21.846354 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c6872843-c615-4222-8f93-e761bcb98ffa tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:21.849906 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c6872843-c615-4222-8f93-e761bcb98ffa tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 40b9689f-c878-4777-b81b-976434249834] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:21.852796 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c6872843-c615-4222-8f93-e761bcb98ffa tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:21.853771 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c6872843-c615-4222-8f93-e761bcb98ffa tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:21.854010 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c6872843-c615-4222-8f93-e761bcb98ffa tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:21.854442 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c6872843-c615-4222-8f93-e761bcb98ffa tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:21.867898 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-c6872843-c615-4222-8f93-e761bcb98ffa tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] HTTP exception thrown: Instance 40b9689f-c878-4777-b81b-976434249834 could not be found. Oct 12 18:30:21.868523 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c6872843-c615-4222-8f93-e761bcb98ffa tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Returning 404 to user: Instance 40b9689f-c878-4777-b81b-976434249834 could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:30:21.869351 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c6872843-c615-4222-8f93-e761bcb98ffa tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834" status: 404 len: 111 microversion: 2.1 time: 0.027573 Oct 12 18:30:21.869899 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 351/711] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:21 2021] GET /compute/v2.1/servers/40b9689f-c878-4777-b81b-976434249834 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:30:21.878202 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-8855393e-7a2e-4d99-8063-0975295e6a9f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:21.878728 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-8855393e-7a2e-4d99-8063-0975295e6a9f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:21.886983 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8855393e-7a2e-4d99-8063-0975295e6a9f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:21.887423 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8855393e-7a2e-4d99-8063-0975295e6a9f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:21.888203 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8855393e-7a2e-4d99-8063-0975295e6a9f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:21.888669 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8855393e-7a2e-4d99-8063-0975295e6a9f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:21.918794 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-8855393e-7a2e-4d99-8063-0975295e6a9f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Going to try to terminate instance {{(pid=109169) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 18:30:22.318102 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-8855393e-7a2e-4d99-8063-0975295e6a9f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 204 len: 0 microversion: 2.1 time: 0.443542 Oct 12 18:30:22.318700 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 361/712] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Oct 12 18:30:21 2021] DELETE /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 18:30:22.329374 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-060df015-7247-469d-9b0c-07ba2daa8b0b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:22.330582 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-060df015-7247-469d-9b0c-07ba2daa8b0b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:22.336905 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-060df015-7247-469d-9b0c-07ba2daa8b0b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:22.336905 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-060df015-7247-469d-9b0c-07ba2daa8b0b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:22.337583 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-060df015-7247-469d-9b0c-07ba2daa8b0b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:22.338018 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-060df015-7247-469d-9b0c-07ba2daa8b0b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:22.465946 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-060df015-7247-469d-9b0c-07ba2daa8b0b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:22.473220 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-060df015-7247-469d-9b0c-07ba2daa8b0b tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.148510 Oct 12 18:30:22.473787 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 352/713] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:22 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:22.571791 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-79d439a4-3854-4a0e-9abb-340352c0a488 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:22.572773 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-79d439a4-3854-4a0e-9abb-340352c0a488 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:22.579004 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-79d439a4-3854-4a0e-9abb-340352c0a488 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:22.579446 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-79d439a4-3854-4a0e-9abb-340352c0a488 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:22.580271 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-79d439a4-3854-4a0e-9abb-340352c0a488 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:22.580734 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-79d439a4-3854-4a0e-9abb-340352c0a488 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:22.709657 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-79d439a4-3854-4a0e-9abb-340352c0a488 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:22.718679 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-79d439a4-3854-4a0e-9abb-340352c0a488 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:22.720119 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-79d439a4-3854-4a0e-9abb-340352c0a488 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:22.721490 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-79d439a4-3854-4a0e-9abb-340352c0a488 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1807 microversion: 2.20 time: 0.153771 Oct 12 18:30:22.722042 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 362/714] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:30:22 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:30:23.490050 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d36ba18a-a049-4fe9-bf5c-afaf038f524f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:23.490701 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d36ba18a-a049-4fe9-bf5c-afaf038f524f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:23.496639 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d36ba18a-a049-4fe9-bf5c-afaf038f524f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:23.497219 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d36ba18a-a049-4fe9-bf5c-afaf038f524f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:23.498000 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d36ba18a-a049-4fe9-bf5c-afaf038f524f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:23.499488 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d36ba18a-a049-4fe9-bf5c-afaf038f524f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:23.629759 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d36ba18a-a049-4fe9-bf5c-afaf038f524f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:23.637359 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d36ba18a-a049-4fe9-bf5c-afaf038f524f tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.150974 Oct 12 18:30:23.637917 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 353/715] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:23 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:23.739535 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-d839c4bb-08a9-4253-b1b5-3fe9e2b4b786 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:23.740180 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-d839c4bb-08a9-4253-b1b5-3fe9e2b4b786 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:23.746197 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d839c4bb-08a9-4253-b1b5-3fe9e2b4b786 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:23.746668 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d839c4bb-08a9-4253-b1b5-3fe9e2b4b786 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:23.747437 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d839c4bb-08a9-4253-b1b5-3fe9e2b4b786 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:23.747865 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d839c4bb-08a9-4253-b1b5-3fe9e2b4b786 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:23.878232 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-d839c4bb-08a9-4253-b1b5-3fe9e2b4b786 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:23.887133 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-d839c4bb-08a9-4253-b1b5-3fe9e2b4b786 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:23.888741 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-d839c4bb-08a9-4253-b1b5-3fe9e2b4b786 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:23.896178 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-d839c4bb-08a9-4253-b1b5-3fe9e2b4b786 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1794 microversion: 2.20 time: 0.154634 Oct 12 18:30:23.896178 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 363/716] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:30:23 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1794 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:30:24.655127 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e22eae7d-e3d8-48ef-be95-50aa6a7cb0fb tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:24.655729 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e22eae7d-e3d8-48ef-be95-50aa6a7cb0fb tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:24.661563 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e22eae7d-e3d8-48ef-be95-50aa6a7cb0fb tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:24.662066 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e22eae7d-e3d8-48ef-be95-50aa6a7cb0fb tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:24.662782 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e22eae7d-e3d8-48ef-be95-50aa6a7cb0fb tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:24.663220 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e22eae7d-e3d8-48ef-be95-50aa6a7cb0fb tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:24.791358 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e22eae7d-e3d8-48ef-be95-50aa6a7cb0fb tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:24.799035 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e22eae7d-e3d8-48ef-be95-50aa6a7cb0fb tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.147252 Oct 12 18:30:24.799591 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 354/717] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:24 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:25.816207 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-30f5907a-32dd-4272-a374-d2f55f0f9dc5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:25.816835 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-30f5907a-32dd-4272-a374-d2f55f0f9dc5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:25.822708 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-30f5907a-32dd-4272-a374-d2f55f0f9dc5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:25.823143 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-30f5907a-32dd-4272-a374-d2f55f0f9dc5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:25.823906 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-30f5907a-32dd-4272-a374-d2f55f0f9dc5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:25.824334 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-30f5907a-32dd-4272-a374-d2f55f0f9dc5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:25.966018 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-30f5907a-32dd-4272-a374-d2f55f0f9dc5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:25.973467 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-30f5907a-32dd-4272-a374-d2f55f0f9dc5 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.161484 Oct 12 18:30:25.974038 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 364/718] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:25 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:26.990353 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-538fb23e-1749-4988-a3b9-6c1b9e7200b0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:26.990962 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-538fb23e-1749-4988-a3b9-6c1b9e7200b0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:27.004082 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-538fb23e-1749-4988-a3b9-6c1b9e7200b0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:27.004557 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-538fb23e-1749-4988-a3b9-6c1b9e7200b0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:27.005326 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-538fb23e-1749-4988-a3b9-6c1b9e7200b0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:27.005747 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-538fb23e-1749-4988-a3b9-6c1b9e7200b0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:27.136860 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-538fb23e-1749-4988-a3b9-6c1b9e7200b0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:27.145536 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-538fb23e-1749-4988-a3b9-6c1b9e7200b0 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.158864 Oct 12 18:30:27.146108 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 355/719] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:26 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:28.162938 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-76ff9d17-6565-4d9c-948d-ae6afdd8ac92 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:28.163535 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-76ff9d17-6565-4d9c-948d-ae6afdd8ac92 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:28.169417 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-76ff9d17-6565-4d9c-948d-ae6afdd8ac92 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:28.169852 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-76ff9d17-6565-4d9c-948d-ae6afdd8ac92 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:28.170607 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-76ff9d17-6565-4d9c-948d-ae6afdd8ac92 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:28.171026 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-76ff9d17-6565-4d9c-948d-ae6afdd8ac92 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:28.307459 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-76ff9d17-6565-4d9c-948d-ae6afdd8ac92 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:28.315440 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-76ff9d17-6565-4d9c-948d-ae6afdd8ac92 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1523 microversion: 2.1 time: 0.156132 Oct 12 18:30:28.316426 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 365/720] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:28 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:29.249811 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-c4037c9a-7ba9-4254-8006-6ce794858047 req-3d15d2f9-8c1d-470a-a3fc-96c518eb033a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ade368f-e898-4346-83a8-3d3eb86c8192", "name": "network-vif-deleted", "tag": "fc8c6d70-7941-4089-842b-2e9d99ab6161"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:30:29.251578 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:30:29.251578 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:30:29.258551 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-c4037c9a-7ba9-4254-8006-6ce794858047 req-3d15d2f9-8c1d-470a-a3fc-96c518eb033a service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:29.258994 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-c4037c9a-7ba9-4254-8006-6ce794858047 req-3d15d2f9-8c1d-470a-a3fc-96c518eb033a service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:29.274648 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-c4037c9a-7ba9-4254-8006-6ce794858047 req-3d15d2f9-8c1d-470a-a3fc-96c518eb033a service nova] Creating event network-vif-deleted:fc8c6d70-7941-4089-842b-2e9d99ab6161 for instance 4ade368f-e898-4346-83a8-3d3eb86c8192 on hv-cinder-81322 Oct 12 18:30:29.280657 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-c4037c9a-7ba9-4254-8006-6ce794858047 req-3d15d2f9-8c1d-470a-a3fc-96c518eb033a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034160 Oct 12 18:30:29.281382 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 356/721] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:30:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:30:29.332192 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-1c2f686d-d4ff-4a8b-a5f5-ca1f82879156 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:29.332842 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-1c2f686d-d4ff-4a8b-a5f5-ca1f82879156 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:29.339025 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1c2f686d-d4ff-4a8b-a5f5-ca1f82879156 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:29.345924 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1c2f686d-d4ff-4a8b-a5f5-ca1f82879156 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:29.345924 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1c2f686d-d4ff-4a8b-a5f5-ca1f82879156 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:29.345924 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1c2f686d-d4ff-4a8b-a5f5-ca1f82879156 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:29.408271 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-1c2f686d-d4ff-4a8b-a5f5-ca1f82879156 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adee358392264c9cad3d3ee92c9aadd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fb6543096402dbf4351b0e6639431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:29.415657 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-1c2f686d-d4ff-4a8b-a5f5-ca1f82879156 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 200 len: 1481 microversion: 2.1 time: 0.087589 Oct 12 18:30:29.416229 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 366/722] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:29 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 1481 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:30.432732 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e8509981-73da-4142-8a08-1f2deb40dd01 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:30.433429 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e8509981-73da-4142-8a08-1f2deb40dd01 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] [instance: 4ade368f-e898-4346-83a8-3d3eb86c8192] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:30.440592 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e8509981-73da-4142-8a08-1f2deb40dd01 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:30.441175 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e8509981-73da-4142-8a08-1f2deb40dd01 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:30.441955 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e8509981-73da-4142-8a08-1f2deb40dd01 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:30.442382 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e8509981-73da-4142-8a08-1f2deb40dd01 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:30.457003 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-e8509981-73da-4142-8a08-1f2deb40dd01 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] HTTP exception thrown: Instance 4ade368f-e898-4346-83a8-3d3eb86c8192 could not be found. Oct 12 18:30:30.457590 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e8509981-73da-4142-8a08-1f2deb40dd01 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] Returning 404 to user: Instance 4ade368f-e898-4346-83a8-3d3eb86c8192 could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:30:30.458408 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e8509981-73da-4142-8a08-1f2deb40dd01 tempest-ServerRescueNegativeTestJSON-2142969126 tempest-ServerRescueNegativeTestJSON-2142969126-project] 10.222.0.18 "GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192" status: 404 len: 111 microversion: 2.1 time: 0.029704 Oct 12 18:30:30.458950 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 357/723] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:30 2021] GET /compute/v2.1/servers/4ade368f-e898-4346-83a8-3d3eb86c8192 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:30:35.999308 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-1fd16566-6ad4-488e-83e8-98f2f118f33b tempest-VolumesNegativeTest-1981979785 tempest-VolumesNegativeTest-1981979785-project] Action: 'create', calling method: .version_select at 0x7fe297e03ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1815772774", "metadata": {"Type": "work"}}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:30:36.000874 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-1fd16566-6ad4-488e-83e8-98f2f118f33b tempest-VolumesNegativeTest-1981979785 tempest-VolumesNegativeTest-1981979785-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=109169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:30:36.002226 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-1fd16566-6ad4-488e-83e8-98f2f118f33b tempest-VolumesNegativeTest-1981979785 tempest-VolumesNegativeTest-1981979785-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.119080 Oct 12 18:30:36.002751 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 367/724] 10.222.0.18 () {60 vars in 1155 bytes} [Tue Oct 12 18:30:35 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 120 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 18:30:36.011922 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-261ed1d6-7500-4575-9731-c56a6fc449d7 tempest-VolumesNegativeTest-1981979785 tempest-VolumesNegativeTest-1981979785-project] Action: 'create', calling method: .version_select at 0x7fe297ded4c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-631083085", "metadata": {"Type": "work"}}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:30:36.013353 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-261ed1d6-7500-4575-9731-c56a6fc449d7 tempest-VolumesNegativeTest-1981979785 tempest-VolumesNegativeTest-1981979785-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:30:36.016265 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-261ed1d6-7500-4575-9731-c56a6fc449d7 tempest-VolumesNegativeTest-1981979785 tempest-VolumesNegativeTest-1981979785-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006106 Oct 12 18:30:36.016265 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 358/725] 10.222.0.18 () {60 vars in 1155 bytes} [Tue Oct 12 18:30:36 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 18:30:36.025119 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-58e38d6b-7a2c-4772-a6fd-d9874323b288 tempest-VolumesNegativeTest-1981979785 tempest-VolumesNegativeTest-1981979785-project] Action: 'create', calling method: .version_select at 0x7fe297e89d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-95775753", "metadata": {"Type": "work"}}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:30:36.026314 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-58e38d6b-7a2c-4772-a6fd-d9874323b288 tempest-VolumesNegativeTest-1981979785 tempest-VolumesNegativeTest-1981979785-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=109169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:30:36.027123 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-58e38d6b-7a2c-4772-a6fd-d9874323b288 tempest-VolumesNegativeTest-1981979785 tempest-VolumesNegativeTest-1981979785-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006834 Oct 12 18:30:36.027969 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 368/726] 10.222.0.18 () {60 vars in 1155 bytes} [Tue Oct 12 18:30:36 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 18:30:36.036861 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3e18a1b5-8f49-4409-8687-71ad5e8fc210 tempest-VolumesNegativeTest-1981979785 tempest-VolumesNegativeTest-1981979785-project] Calling method '.version_select at 0x7fe297f3f820>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:36.176772 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-3e18a1b5-8f49-4409-8687-71ad5e8fc210 tempest-VolumesNegativeTest-1981979785 tempest-VolumesNegativeTest-1981979785-project] HTTP exception thrown: Volume tempest-invalid-1178889577 could not be found. Oct 12 18:30:36.177370 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3e18a1b5-8f49-4409-8687-71ad5e8fc210 tempest-VolumesNegativeTest-1981979785 tempest-VolumesNegativeTest-1981979785-project] Returning 404 to user: Volume tempest-invalid-1178889577 could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:30:36.178205 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3e18a1b5-8f49-4409-8687-71ad5e8fc210 tempest-VolumesNegativeTest-1981979785 tempest-VolumesNegativeTest-1981979785-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1178889577" status: 404 len: 99 microversion: 2.1 time: 0.144973 Oct 12 18:30:36.178761 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 359/727] 10.222.0.18 () {58 vars in 1217 bytes} [Tue Oct 12 18:30:36 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1178889577 => generated 99 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 18:30:36.190329 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-2becdd60-252f-4988-b978-4a012b108b41 tempest-VolumesNegativeTest-1981979785 tempest-VolumesNegativeTest-1981979785-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004418 Oct 12 18:30:36.190329 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 369/728] 10.222.0.18 () {58 vars in 1139 bytes} [Tue Oct 12 18:30:36 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 12 18:30:36.199029 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a8ef50c4-a075-4f80-9609-f4ebd50f1b05 tempest-VolumesNegativeTest-1981979785 tempest-VolumesNegativeTest-1981979785-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003537 Oct 12 18:30:36.201950 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 360/729] 10.222.0.18 () {58 vars in 1136 bytes} [Tue Oct 12 18:30:36 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 12 18:30:36.208428 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-1bea9372-fd27-4d61-97c2-91aa6a644a79 tempest-VolumesNegativeTest-1981979785 tempest-VolumesNegativeTest-1981979785-project] Calling method '.version_select at 0x7fe297f43d30>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:36.303197 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.wsgi [None req-1bea9372-fd27-4d61-97c2-91aa6a644a79 tempest-VolumesNegativeTest-1981979785 tempest-VolumesNegativeTest-1981979785-project] HTTP exception thrown: Volume 44db4f70-99d9-46f1-b926-ad9c4cca6d69 could not be found. Oct 12 18:30:36.303825 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-1bea9372-fd27-4d61-97c2-91aa6a644a79 tempest-VolumesNegativeTest-1981979785 tempest-VolumesNegativeTest-1981979785-project] Returning 404 to user: Volume 44db4f70-99d9-46f1-b926-ad9c4cca6d69 could not be found. {{(pid=109169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:30:36.304870 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-1bea9372-fd27-4d61-97c2-91aa6a644a79 tempest-VolumesNegativeTest-1981979785 tempest-VolumesNegativeTest-1981979785-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/44db4f70-99d9-46f1-b926-ad9c4cca6d69" status: 404 len: 109 microversion: 2.1 time: 0.100041 Oct 12 18:30:36.305480 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 370/730] 10.222.0.18 () {58 vars in 1247 bytes} [Tue Oct 12 18:30:36 2021] DELETE /compute/v2.1/os-volumes/44db4f70-99d9-46f1-b926-ad9c4cca6d69 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 18:30:36.314923 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1bd32789-d702-4e30-86df-d01528c791b5 tempest-VolumesNegativeTest-1981979785 tempest-VolumesNegativeTest-1981979785-project] Calling method '.version_select at 0x7fe297dede50>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:36.341224 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-1bd32789-d702-4e30-86df-d01528c791b5 tempest-VolumesNegativeTest-1981979785 tempest-VolumesNegativeTest-1981979785-project] HTTP exception thrown: Volume ee3c0d26-a750-4b62-8ea8-26fa44cad9d5 could not be found. Oct 12 18:30:36.341925 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1bd32789-d702-4e30-86df-d01528c791b5 tempest-VolumesNegativeTest-1981979785 tempest-VolumesNegativeTest-1981979785-project] Returning 404 to user: Volume ee3c0d26-a750-4b62-8ea8-26fa44cad9d5 could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:30:36.342786 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1bd32789-d702-4e30-86df-d01528c791b5 tempest-VolumesNegativeTest-1981979785 tempest-VolumesNegativeTest-1981979785-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/ee3c0d26-a750-4b62-8ea8-26fa44cad9d5" status: 404 len: 109 microversion: 2.1 time: 0.031577 Oct 12 18:30:36.343324 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 361/731] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Oct 12 18:30:36 2021] GET /compute/v2.1/os-volumes/ee3c0d26-a750-4b62-8ea8-26fa44cad9d5 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:30:38.252488 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-e120e0c8-95bc-4124-a318-97eba52f1b4d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:38.253046 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-e120e0c8-95bc-4124-a318-97eba52f1b4d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:38.259945 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e120e0c8-95bc-4124-a318-97eba52f1b4d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:38.260461 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e120e0c8-95bc-4124-a318-97eba52f1b4d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:38.261228 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e120e0c8-95bc-4124-a318-97eba52f1b4d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:38.261720 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e120e0c8-95bc-4124-a318-97eba52f1b4d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:38.340668 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.objects.instance [None req-e120e0c8-95bc-4124-a318-97eba52f1b4d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lazy-loading 'services' on Instance uuid 1ad61db5-995d-47f1-a6d6-891628733252 {{(pid=109169) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:30:38.608592 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-e120e0c8-95bc-4124-a318-97eba52f1b4d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/os-volume_attachments/301df3e6-d14c-4ee2-869b-c604e4a3ecce" status: 202 len: 0 microversion: 2.1 time: 0.355415 Oct 12 18:30:38.608592 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 371/732] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Oct 12 18:30:38 2021] DELETE /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/os-volume_attachments/301df3e6-d14c-4ee2-869b-c604e4a3ecce => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:30:39.786935 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e54cf354-afac-4256-bb83-beab6326f567 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:30:39.795852 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e54cf354-afac-4256-bb83-beab6326f567 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:39.796595 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e54cf354-afac-4256-bb83-beab6326f567 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:39.821003 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e54cf354-afac-4256-bb83-beab6326f567 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Going to try to stop instance {{(pid=109168) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Oct 12 18:30:40.055008 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e54cf354-afac-4256-bb83-beab6326f567 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 202 len: 0 microversion: 2.1 time: 0.274427 Oct 12 18:30:40.055839 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 362/733] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:30:39 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:30:40.065611 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-8b168acf-2406-4422-ae07-8a7dc8f6361d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:40.066341 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-8b168acf-2406-4422-ae07-8a7dc8f6361d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:40.073077 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8b168acf-2406-4422-ae07-8a7dc8f6361d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:40.073591 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8b168acf-2406-4422-ae07-8a7dc8f6361d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:40.074564 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8b168acf-2406-4422-ae07-8a7dc8f6361d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:40.075001 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8b168acf-2406-4422-ae07-8a7dc8f6361d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:40.241539 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-8b168acf-2406-4422-ae07-8a7dc8f6361d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:40.249945 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-8b168acf-2406-4422-ae07-8a7dc8f6361d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1678 microversion: 2.1 time: 0.188732 Oct 12 18:30:40.252447 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 372/734] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:40 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1678 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:41.273709 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-519f8f93-ecea-4264-99ef-c59b17deb31f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:41.274903 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-519f8f93-ecea-4264-99ef-c59b17deb31f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:41.285238 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-519f8f93-ecea-4264-99ef-c59b17deb31f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:41.285930 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-519f8f93-ecea-4264-99ef-c59b17deb31f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:41.287438 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-519f8f93-ecea-4264-99ef-c59b17deb31f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:41.288145 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-519f8f93-ecea-4264-99ef-c59b17deb31f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:41.422082 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-519f8f93-ecea-4264-99ef-c59b17deb31f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:41.430900 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-519f8f93-ecea-4264-99ef-c59b17deb31f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1678 microversion: 2.1 time: 0.165256 Oct 12 18:30:41.431472 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 363/735] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:41 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:42.407379 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 18:30:42.408110 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: Tue Oct 12 18:30:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 12 18:30:42.633042 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-4af86566-9f8d-44ff-977f-1099f2c51766 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:42.633653 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-4af86566-9f8d-44ff-977f-1099f2c51766 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:42.640519 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4af86566-9f8d-44ff-977f-1099f2c51766 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:42.640964 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4af86566-9f8d-44ff-977f-1099f2c51766 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:42.642646 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4af86566-9f8d-44ff-977f-1099f2c51766 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:42.643077 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4af86566-9f8d-44ff-977f-1099f2c51766 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:42.773916 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-4af86566-9f8d-44ff-977f-1099f2c51766 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:42.782343 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-4af86566-9f8d-44ff-977f-1099f2c51766 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1678 microversion: 2.1 time: 0.336834 Oct 12 18:30:42.783141 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 373/736] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:42 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1678 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:43.799075 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8fc294f1-83c1-45d8-8c4d-23a035f66cf3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:43.799751 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8fc294f1-83c1-45d8-8c4d-23a035f66cf3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:43.806033 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8fc294f1-83c1-45d8-8c4d-23a035f66cf3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:43.806473 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8fc294f1-83c1-45d8-8c4d-23a035f66cf3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:43.807261 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8fc294f1-83c1-45d8-8c4d-23a035f66cf3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:43.807718 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8fc294f1-83c1-45d8-8c4d-23a035f66cf3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:43.964695 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8fc294f1-83c1-45d8-8c4d-23a035f66cf3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:43.973990 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8fc294f1-83c1-45d8-8c4d-23a035f66cf3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1678 microversion: 2.1 time: 0.178080 Oct 12 18:30:43.975084 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 364/737] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:43 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:44.992176 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c3067ea0-d127-483c-aac8-65e43c467b3e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:44.992847 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c3067ea0-d127-483c-aac8-65e43c467b3e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:44.999935 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c3067ea0-d127-483c-aac8-65e43c467b3e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:45.000379 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c3067ea0-d127-483c-aac8-65e43c467b3e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:45.001197 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c3067ea0-d127-483c-aac8-65e43c467b3e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:45.001644 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c3067ea0-d127-483c-aac8-65e43c467b3e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:45.358844 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c3067ea0-d127-483c-aac8-65e43c467b3e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:45.366864 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c3067ea0-d127-483c-aac8-65e43c467b3e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1678 microversion: 2.1 time: 0.378307 Oct 12 18:30:45.367590 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 374/738] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:44 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1678 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:46.384158 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2c390aca-ed6a-4107-b8b8-e24a324c81bc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:46.384831 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2c390aca-ed6a-4107-b8b8-e24a324c81bc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:46.391257 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2c390aca-ed6a-4107-b8b8-e24a324c81bc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:46.391704 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2c390aca-ed6a-4107-b8b8-e24a324c81bc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:46.392628 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2c390aca-ed6a-4107-b8b8-e24a324c81bc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:46.393068 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2c390aca-ed6a-4107-b8b8-e24a324c81bc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:46.532955 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2c390aca-ed6a-4107-b8b8-e24a324c81bc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:46.540902 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2c390aca-ed6a-4107-b8b8-e24a324c81bc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1678 microversion: 2.1 time: 0.160547 Oct 12 18:30:46.541471 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 365/739] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:46 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:47.558397 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-1cc3a0d6-245e-4a6e-aac2-e182ff49fd00 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:47.559617 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-1cc3a0d6-245e-4a6e-aac2-e182ff49fd00 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:47.570866 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1cc3a0d6-245e-4a6e-aac2-e182ff49fd00 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:47.571750 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1cc3a0d6-245e-4a6e-aac2-e182ff49fd00 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:47.573122 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1cc3a0d6-245e-4a6e-aac2-e182ff49fd00 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:47.573809 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1cc3a0d6-245e-4a6e-aac2-e182ff49fd00 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:47.725679 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-1cc3a0d6-245e-4a6e-aac2-e182ff49fd00 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:47.733512 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-1cc3a0d6-245e-4a6e-aac2-e182ff49fd00 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1678 microversion: 2.1 time: 0.178286 Oct 12 18:30:47.733735 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 375/740] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:47 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:48.750595 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0769908b-8533-4499-aeac-9724e2063b6b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:48.751768 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0769908b-8533-4499-aeac-9724e2063b6b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:48.758035 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0769908b-8533-4499-aeac-9724e2063b6b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:48.758475 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0769908b-8533-4499-aeac-9724e2063b6b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:48.759242 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0769908b-8533-4499-aeac-9724e2063b6b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:48.759669 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0769908b-8533-4499-aeac-9724e2063b6b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:48.887476 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0769908b-8533-4499-aeac-9724e2063b6b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:48.894743 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0769908b-8533-4499-aeac-9724e2063b6b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1678 microversion: 2.1 time: 0.147903 Oct 12 18:30:48.895296 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 366/741] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:48 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:49.915374 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c4857810-68f7-40de-984d-1d9dc69d602a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:49.915945 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c4857810-68f7-40de-984d-1d9dc69d602a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:49.922180 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c4857810-68f7-40de-984d-1d9dc69d602a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:49.922619 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c4857810-68f7-40de-984d-1d9dc69d602a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:49.923379 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c4857810-68f7-40de-984d-1d9dc69d602a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:49.923804 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c4857810-68f7-40de-984d-1d9dc69d602a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:50.046033 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c4857810-68f7-40de-984d-1d9dc69d602a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:50.053418 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c4857810-68f7-40de-984d-1d9dc69d602a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1678 microversion: 2.1 time: 0.141922 Oct 12 18:30:50.053991 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 376/742] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:49 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1678 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:51.070931 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1eaf94b2-4ee2-4de4-a31e-77f439ecf291 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:51.071696 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1eaf94b2-4ee2-4de4-a31e-77f439ecf291 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:51.079745 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1eaf94b2-4ee2-4de4-a31e-77f439ecf291 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:51.080543 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1eaf94b2-4ee2-4de4-a31e-77f439ecf291 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:51.081616 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1eaf94b2-4ee2-4de4-a31e-77f439ecf291 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:51.082213 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1eaf94b2-4ee2-4de4-a31e-77f439ecf291 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:51.217806 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1eaf94b2-4ee2-4de4-a31e-77f439ecf291 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:51.225938 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1eaf94b2-4ee2-4de4-a31e-77f439ecf291 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1678 microversion: 2.1 time: 0.159825 Oct 12 18:30:51.226496 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 367/743] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:51 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:52.252771 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-53c3bf0f-e9f6-4c77-8ed5-ebbc289bd0a9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:52.253390 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-53c3bf0f-e9f6-4c77-8ed5-ebbc289bd0a9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:52.259407 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-53c3bf0f-e9f6-4c77-8ed5-ebbc289bd0a9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:52.259854 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-53c3bf0f-e9f6-4c77-8ed5-ebbc289bd0a9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:52.260664 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-53c3bf0f-e9f6-4c77-8ed5-ebbc289bd0a9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:52.261108 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-53c3bf0f-e9f6-4c77-8ed5-ebbc289bd0a9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:52.390914 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-53c3bf0f-e9f6-4c77-8ed5-ebbc289bd0a9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:52.398370 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-53c3bf0f-e9f6-4c77-8ed5-ebbc289bd0a9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1678 microversion: 2.1 time: 0.149796 Oct 12 18:30:52.398947 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 377/744] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:52 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:53.415469 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-65b6fec5-b9d9-4ad0-84e4-96e7bf48d3d7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:53.416106 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-65b6fec5-b9d9-4ad0-84e4-96e7bf48d3d7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:53.421979 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-65b6fec5-b9d9-4ad0-84e4-96e7bf48d3d7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:53.422425 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-65b6fec5-b9d9-4ad0-84e4-96e7bf48d3d7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:53.423195 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-65b6fec5-b9d9-4ad0-84e4-96e7bf48d3d7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:53.423638 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-65b6fec5-b9d9-4ad0-84e4-96e7bf48d3d7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:53.546781 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-65b6fec5-b9d9-4ad0-84e4-96e7bf48d3d7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:53.554478 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-65b6fec5-b9d9-4ad0-84e4-96e7bf48d3d7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1678 microversion: 2.1 time: 0.142642 Oct 12 18:30:53.555046 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 368/745] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:53 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1678 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:54.575358 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-2b4c6704-5512-432e-be90-9f511c05372c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:54.576057 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-2b4c6704-5512-432e-be90-9f511c05372c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:54.581945 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2b4c6704-5512-432e-be90-9f511c05372c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:54.582393 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2b4c6704-5512-432e-be90-9f511c05372c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:54.583975 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2b4c6704-5512-432e-be90-9f511c05372c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:54.584440 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2b4c6704-5512-432e-be90-9f511c05372c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:54.719355 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-2b4c6704-5512-432e-be90-9f511c05372c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:54.726056 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-2b4c6704-5512-432e-be90-9f511c05372c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1678 microversion: 2.1 time: 0.154628 Oct 12 18:30:54.727038 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 378/746] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:54 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:55.743242 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e9c8f50f-31e5-40f4-8592-8723d9026f43 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:55.743879 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e9c8f50f-31e5-40f4-8592-8723d9026f43 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:55.749699 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e9c8f50f-31e5-40f4-8592-8723d9026f43 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:55.750201 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e9c8f50f-31e5-40f4-8592-8723d9026f43 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:55.750968 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e9c8f50f-31e5-40f4-8592-8723d9026f43 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:55.751403 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e9c8f50f-31e5-40f4-8592-8723d9026f43 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:55.875606 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e9c8f50f-31e5-40f4-8592-8723d9026f43 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:55.887963 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e9c8f50f-31e5-40f4-8592-8723d9026f43 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1678 microversion: 2.1 time: 0.148315 Oct 12 18:30:55.888604 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 369/747] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:55 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:56.906170 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-386c9a14-1c8d-43e8-bb2c-946f27c43e43 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:56.906838 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-386c9a14-1c8d-43e8-bb2c-946f27c43e43 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:56.913314 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-386c9a14-1c8d-43e8-bb2c-946f27c43e43 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:56.913752 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-386c9a14-1c8d-43e8-bb2c-946f27c43e43 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:56.914511 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-386c9a14-1c8d-43e8-bb2c-946f27c43e43 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:56.915041 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-386c9a14-1c8d-43e8-bb2c-946f27c43e43 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:57.046170 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-386c9a14-1c8d-43e8-bb2c-946f27c43e43 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:57.053689 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-386c9a14-1c8d-43e8-bb2c-946f27c43e43 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1678 microversion: 2.1 time: 0.151419 Oct 12 18:30:57.054253 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 379/748] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:56 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:58.070724 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-dee218e4-515b-4374-9751-f9f5ef96c699 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:58.071326 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-dee218e4-515b-4374-9751-f9f5ef96c699 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:58.077128 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dee218e4-515b-4374-9751-f9f5ef96c699 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:58.077565 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dee218e4-515b-4374-9751-f9f5ef96c699 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:58.078317 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dee218e4-515b-4374-9751-f9f5ef96c699 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:58.078743 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dee218e4-515b-4374-9751-f9f5ef96c699 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:58.215704 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-dee218e4-515b-4374-9751-f9f5ef96c699 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:58.223499 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-dee218e4-515b-4374-9751-f9f5ef96c699 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1678 microversion: 2.1 time: 0.156377 Oct 12 18:30:58.224068 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 370/749] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:58 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:30:59.241521 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-5b29bf78-ab01-4373-8b91-2a88f1becc17 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:30:59.242151 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-5b29bf78-ab01-4373-8b91-2a88f1becc17 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:30:59.248312 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5b29bf78-ab01-4373-8b91-2a88f1becc17 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:59.248787 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5b29bf78-ab01-4373-8b91-2a88f1becc17 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:59.249547 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5b29bf78-ab01-4373-8b91-2a88f1becc17 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:30:59.250081 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5b29bf78-ab01-4373-8b91-2a88f1becc17 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:30:59.380966 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-5b29bf78-ab01-4373-8b91-2a88f1becc17 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:30:59.388836 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-5b29bf78-ab01-4373-8b91-2a88f1becc17 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1678 microversion: 2.1 time: 0.151707 Oct 12 18:30:59.389406 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 380/750] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:30:59 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:31:00.408023 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d8b31c9b-624c-4957-bb31-ce9f55b1b75c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:31:00.408605 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d8b31c9b-624c-4957-bb31-ce9f55b1b75c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:31:00.414737 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d8b31c9b-624c-4957-bb31-ce9f55b1b75c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:00.415188 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d8b31c9b-624c-4957-bb31-ce9f55b1b75c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:00.415969 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d8b31c9b-624c-4957-bb31-ce9f55b1b75c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:00.416414 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d8b31c9b-624c-4957-bb31-ce9f55b1b75c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:00.542529 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d8b31c9b-624c-4957-bb31-ce9f55b1b75c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:31:00.550232 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d8b31c9b-624c-4957-bb31-ce9f55b1b75c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1678 microversion: 2.1 time: 0.147280 Oct 12 18:31:00.551330 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 371/751] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:31:00 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:31:01.567680 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-ae0873d9-7162-4bb0-883e-8d854b55102a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:31:01.568723 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-ae0873d9-7162-4bb0-883e-8d854b55102a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:31:01.576291 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ae0873d9-7162-4bb0-883e-8d854b55102a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:01.576934 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ae0873d9-7162-4bb0-883e-8d854b55102a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:01.577930 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ae0873d9-7162-4bb0-883e-8d854b55102a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:01.578293 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ae0873d9-7162-4bb0-883e-8d854b55102a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:01.726862 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-ae0873d9-7162-4bb0-883e-8d854b55102a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:31:01.734545 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-ae0873d9-7162-4bb0-883e-8d854b55102a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1655 microversion: 2.1 time: 0.170504 Oct 12 18:31:01.735149 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 381/752] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:31:01 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1655 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:31:01.756869 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-6b478a3c-308e-4994-b00a-6d8bb475fbdb tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:31:01.762985 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6b478a3c-308e-4994-b00a-6d8bb475fbdb tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:01.763431 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6b478a3c-308e-4994-b00a-6d8bb475fbdb tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:01.786570 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-6b478a3c-308e-4994-b00a-6d8bb475fbdb tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Going to try to start instance {{(pid=109168) start /opt/stack/nova/nova/compute/api.py:2675}} Oct 12 18:31:02.035632 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-6b478a3c-308e-4994-b00a-6d8bb475fbdb tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action" status: 202 len: 0 microversion: 2.1 time: 0.282751 Oct 12 18:31:02.036568 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 372/753] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:31:01 2021] POST /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:31:02.044973 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-f8988020-f4ac-4df6-a9ea-3fa96cfd7fc2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:31:02.045600 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-f8988020-f4ac-4df6-a9ea-3fa96cfd7fc2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:31:02.052314 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f8988020-f4ac-4df6-a9ea-3fa96cfd7fc2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:02.052846 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f8988020-f4ac-4df6-a9ea-3fa96cfd7fc2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:02.053629 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f8988020-f4ac-4df6-a9ea-3fa96cfd7fc2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:02.054062 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f8988020-f4ac-4df6-a9ea-3fa96cfd7fc2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:02.182363 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-f8988020-f4ac-4df6-a9ea-3fa96cfd7fc2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:31:02.190473 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-f8988020-f4ac-4df6-a9ea-3fa96cfd7fc2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1664 microversion: 2.1 time: 0.149363 Oct 12 18:31:02.191048 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 382/754] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:31:02 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1664 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:31:03.209620 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1663542b-a645-418a-a17b-9507eb830783 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:31:03.210309 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1663542b-a645-418a-a17b-9507eb830783 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:31:03.216374 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1663542b-a645-418a-a17b-9507eb830783 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:03.216841 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1663542b-a645-418a-a17b-9507eb830783 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:03.217598 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1663542b-a645-418a-a17b-9507eb830783 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:03.218086 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1663542b-a645-418a-a17b-9507eb830783 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:03.341303 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1663542b-a645-418a-a17b-9507eb830783 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:31:03.348532 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1663542b-a645-418a-a17b-9507eb830783 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1664 microversion: 2.1 time: 0.143422 Oct 12 18:31:03.349101 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 373/755] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:31:03 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1664 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:31:04.364912 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-2e31287c-b771-4580-b3d5-d23feb7dbc0f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:31:04.365501 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-2e31287c-b771-4580-b3d5-d23feb7dbc0f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:31:04.371439 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2e31287c-b771-4580-b3d5-d23feb7dbc0f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:04.371887 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2e31287c-b771-4580-b3d5-d23feb7dbc0f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:04.372684 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2e31287c-b771-4580-b3d5-d23feb7dbc0f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:04.373118 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2e31287c-b771-4580-b3d5-d23feb7dbc0f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:04.504135 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-2e31287c-b771-4580-b3d5-d23feb7dbc0f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:31:04.511459 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-2e31287c-b771-4580-b3d5-d23feb7dbc0f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1664 microversion: 2.1 time: 0.150203 Oct 12 18:31:04.512018 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 383/756] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:31:04 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1664 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:31:05.529388 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ee5e7229-2dd2-4d15-95db-7dcbfddce51c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:31:05.529990 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ee5e7229-2dd2-4d15-95db-7dcbfddce51c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:31:05.536277 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ee5e7229-2dd2-4d15-95db-7dcbfddce51c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:05.536751 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ee5e7229-2dd2-4d15-95db-7dcbfddce51c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:05.537515 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ee5e7229-2dd2-4d15-95db-7dcbfddce51c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:05.537948 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ee5e7229-2dd2-4d15-95db-7dcbfddce51c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:05.659124 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ee5e7229-2dd2-4d15-95db-7dcbfddce51c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:31:05.666903 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ee5e7229-2dd2-4d15-95db-7dcbfddce51c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1664 microversion: 2.1 time: 0.141425 Oct 12 18:31:05.667462 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 374/757] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:31:05 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1664 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:31:06.683906 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-e8e5e2b2-168b-4fb7-bd2c-7ab361d8b926 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:31:06.684540 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-e8e5e2b2-168b-4fb7-bd2c-7ab361d8b926 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:31:06.690882 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e8e5e2b2-168b-4fb7-bd2c-7ab361d8b926 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:06.691355 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e8e5e2b2-168b-4fb7-bd2c-7ab361d8b926 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:06.692167 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e8e5e2b2-168b-4fb7-bd2c-7ab361d8b926 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:06.693267 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e8e5e2b2-168b-4fb7-bd2c-7ab361d8b926 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:06.825534 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-e8e5e2b2-168b-4fb7-bd2c-7ab361d8b926 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:31:06.832921 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-e8e5e2b2-168b-4fb7-bd2c-7ab361d8b926 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1664 microversion: 2.1 time: 0.152603 Oct 12 18:31:06.833527 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 384/758] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:31:06 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1664 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:31:07.850740 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-65ebf8bd-780f-47b3-a4f3-0ce8ed7773df tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:31:07.852636 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-65ebf8bd-780f-47b3-a4f3-0ce8ed7773df tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:31:07.857181 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-65ebf8bd-780f-47b3-a4f3-0ce8ed7773df tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:07.857624 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-65ebf8bd-780f-47b3-a4f3-0ce8ed7773df tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:07.858394 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-65ebf8bd-780f-47b3-a4f3-0ce8ed7773df tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:07.858824 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-65ebf8bd-780f-47b3-a4f3-0ce8ed7773df tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:07.993351 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-65ebf8bd-780f-47b3-a4f3-0ce8ed7773df tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:31:08.001337 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-65ebf8bd-780f-47b3-a4f3-0ce8ed7773df tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1668 microversion: 2.1 time: 0.154708 Oct 12 18:31:08.001917 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 375/759] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:31:07 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:31:46.419510 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0a91fd45-4d9c-4d57-a9f2-a93cb1cf0a15] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 18:31:46.668981 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-b23b3c3c-1f4e-4c04-a8f5-ac3f106ea257 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:31:46.669479 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-b23b3c3c-1f4e-4c04-a8f5-ac3f106ea257 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:31:46.677054 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b23b3c3c-1f4e-4c04-a8f5-ac3f106ea257 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:46.677330 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b23b3c3c-1f4e-4c04-a8f5-ac3f106ea257 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:46.678098 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b23b3c3c-1f4e-4c04-a8f5-ac3f106ea257 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:46.678531 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b23b3c3c-1f4e-4c04-a8f5-ac3f106ea257 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:46.707437 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-b23b3c3c-1f4e-4c04-a8f5-ac3f106ea257 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/os-volume_attachments/b0039d52-f534-4fe3-a649-594d65f2d3bf" status: 200 len: 194 microversion: 2.20 time: 0.293334 Oct 12 18:31:46.708007 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 385/760] 10.222.0.18 () {60 vars in 1453 bytes} [Tue Oct 12 18:31:46 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/os-volume_attachments/b0039d52-f534-4fe3-a649-594d65f2d3bf => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:31:46.768245 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5418089d-c9a8-4c81-893e-77e7092b3db9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:31:46.768861 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5418089d-c9a8-4c81-893e-77e7092b3db9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:31:46.776129 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: ERROR oslo.messaging._drivers.impl_rabbit [-] [95de5915-31ff-43be-b304-c8b7292b5453] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 18:31:46.778337 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5418089d-c9a8-4c81-893e-77e7092b3db9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:46.778778 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5418089d-c9a8-4c81-893e-77e7092b3db9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:46.779540 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5418089d-c9a8-4c81-893e-77e7092b3db9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:46.780180 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5418089d-c9a8-4c81-893e-77e7092b3db9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:46.862098 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-5418089d-c9a8-4c81-893e-77e7092b3db9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lazy-loading 'services' on Instance uuid a13e5623-9ecd-4036-b74a-48cbb84908de {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:31:47.131383 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5418089d-c9a8-4c81-893e-77e7092b3db9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/os-volume_attachments/b0039d52-f534-4fe3-a649-594d65f2d3bf" status: 202 len: 0 microversion: 2.20 time: 0.366732 Oct 12 18:31:47.131969 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 376/761] 10.222.0.18 () {60 vars in 1456 bytes} [Tue Oct 12 18:31:46 2021] DELETE /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/os-volume_attachments/b0039d52-f534-4fe3-a649-594d65f2d3bf => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 18:31:47.140114 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-7a8926fd-2c8c-440c-82a4-83c4cc360878 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:31:47.141053 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-7a8926fd-2c8c-440c-82a4-83c4cc360878 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:31:47.147271 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7a8926fd-2c8c-440c-82a4-83c4cc360878 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:47.147724 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7a8926fd-2c8c-440c-82a4-83c4cc360878 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:47.148520 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7a8926fd-2c8c-440c-82a4-83c4cc360878 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:47.148958 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7a8926fd-2c8c-440c-82a4-83c4cc360878 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:47.179194 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-7a8926fd-2c8c-440c-82a4-83c4cc360878 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042923 Oct 12 18:31:47.179750 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 386/762] 10.222.0.18 () {60 vars in 1342 bytes} [Tue Oct 12 18:31:47 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:31:48.202636 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-6eb5807e-0358-4a5b-8e59-430785cac9cb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:31:48.203679 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-6eb5807e-0358-4a5b-8e59-430785cac9cb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:31:48.210467 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6eb5807e-0358-4a5b-8e59-430785cac9cb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:48.210903 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6eb5807e-0358-4a5b-8e59-430785cac9cb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:48.211679 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6eb5807e-0358-4a5b-8e59-430785cac9cb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:48.212300 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6eb5807e-0358-4a5b-8e59-430785cac9cb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:48.218475 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO oslo.messaging._drivers.impl_rabbit [-] [95de5915-31ff-43be-b304-c8b7292b5453] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40318. Oct 12 18:31:48.248097 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-6eb5807e-0358-4a5b-8e59-430785cac9cb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061238 Oct 12 18:31:48.249050 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 377/763] 10.222.0.18 () {60 vars in 1342 bytes} [Tue Oct 12 18:31:48 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:31:49.262257 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-fe969e8e-c2be-4daa-8e65-f187e7cf12f3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:31:49.263167 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-fe969e8e-c2be-4daa-8e65-f187e7cf12f3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:31:49.281503 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fe969e8e-c2be-4daa-8e65-f187e7cf12f3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:49.281952 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fe969e8e-c2be-4daa-8e65-f187e7cf12f3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:49.282766 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fe969e8e-c2be-4daa-8e65-f187e7cf12f3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:49.283202 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fe969e8e-c2be-4daa-8e65-f187e7cf12f3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:49.288647 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO oslo.messaging._drivers.impl_rabbit [-] [0a91fd45-4d9c-4d57-a9f2-a93cb1cf0a15] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40342. Oct 12 18:31:49.314857 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-fe969e8e-c2be-4daa-8e65-f187e7cf12f3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.056877 Oct 12 18:31:49.315415 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 387/764] 10.222.0.18 () {60 vars in 1342 bytes} [Tue Oct 12 18:31:49 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:31:49.379345 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-20ccab5b-aadb-4bd5-a480-b6d4511edc88 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:31:49.379888 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-20ccab5b-aadb-4bd5-a480-b6d4511edc88 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:31:49.385873 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-20ccab5b-aadb-4bd5-a480-b6d4511edc88 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:49.386847 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-20ccab5b-aadb-4bd5-a480-b6d4511edc88 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:49.387614 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-20ccab5b-aadb-4bd5-a480-b6d4511edc88 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:49.388049 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-20ccab5b-aadb-4bd5-a480-b6d4511edc88 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:49.414589 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-20ccab5b-aadb-4bd5-a480-b6d4511edc88 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Going to try to terminate instance {{(pid=109168) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 18:31:49.783325 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-20ccab5b-aadb-4bd5-a480-b6d4511edc88 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 204 len: 0 microversion: 2.20 time: 0.407311 Oct 12 18:31:49.783909 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 378/765] 10.222.0.18 () {60 vars in 1279 bytes} [Tue Oct 12 18:31:49 2021] DELETE /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 18:31:49.798102 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-893200fa-61ab-4b8d-af11-29a5a0ab4360 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:31:49.799051 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-893200fa-61ab-4b8d-af11-29a5a0ab4360 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:31:49.805266 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-893200fa-61ab-4b8d-af11-29a5a0ab4360 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:49.805709 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-893200fa-61ab-4b8d-af11-29a5a0ab4360 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:49.806486 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-893200fa-61ab-4b8d-af11-29a5a0ab4360 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:49.806919 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-893200fa-61ab-4b8d-af11-29a5a0ab4360 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:49.947491 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-893200fa-61ab-4b8d-af11-29a5a0ab4360 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:31:49.956499 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-893200fa-61ab-4b8d-af11-29a5a0ab4360 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:31:49.958068 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-893200fa-61ab-4b8d-af11-29a5a0ab4360 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:31:49.959487 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-893200fa-61ab-4b8d-af11-29a5a0ab4360 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1722 microversion: 2.20 time: 0.170874 Oct 12 18:31:49.960250 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 388/766] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:31:49 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:31:50.985034 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-17cdc71c-2bdb-4c74-9d9f-6a59bd4d1f31 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:31:50.985034 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-17cdc71c-2bdb-4c74-9d9f-6a59bd4d1f31 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:31:50.989650 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-17cdc71c-2bdb-4c74-9d9f-6a59bd4d1f31 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:50.992300 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-17cdc71c-2bdb-4c74-9d9f-6a59bd4d1f31 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:50.992300 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-17cdc71c-2bdb-4c74-9d9f-6a59bd4d1f31 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:50.992300 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-17cdc71c-2bdb-4c74-9d9f-6a59bd4d1f31 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:51.123652 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-17cdc71c-2bdb-4c74-9d9f-6a59bd4d1f31 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:31:51.132684 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-17cdc71c-2bdb-4c74-9d9f-6a59bd4d1f31 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:31:51.134173 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-17cdc71c-2bdb-4c74-9d9f-6a59bd4d1f31 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:31:51.135322 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-17cdc71c-2bdb-4c74-9d9f-6a59bd4d1f31 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1722 microversion: 2.20 time: 0.157582 Oct 12 18:31:51.136708 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 379/767] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:31:50 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:31:52.155688 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-34880b73-6bde-4ba6-a9e6-274ce60a651e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:31:52.156347 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-34880b73-6bde-4ba6-a9e6-274ce60a651e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:31:52.162391 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-34880b73-6bde-4ba6-a9e6-274ce60a651e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:52.169663 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-34880b73-6bde-4ba6-a9e6-274ce60a651e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:52.169663 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-34880b73-6bde-4ba6-a9e6-274ce60a651e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:52.169663 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-34880b73-6bde-4ba6-a9e6-274ce60a651e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:52.353465 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-34880b73-6bde-4ba6-a9e6-274ce60a651e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:31:52.367231 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-34880b73-6bde-4ba6-a9e6-274ce60a651e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:31:52.370044 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-34880b73-6bde-4ba6-a9e6-274ce60a651e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:31:52.371634 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-34880b73-6bde-4ba6-a9e6-274ce60a651e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1722 microversion: 2.20 time: 0.220484 Oct 12 18:31:52.372506 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 389/768] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:31:52 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:31:52.935037 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-a221db03-8961-487e-86ff-948d91fbe6bf req-5906d4a3-4e98-4266-94ed-9cf45e2998e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a13e5623-9ecd-4036-b74a-48cbb84908de", "name": "network-vif-deleted", "tag": "fabaeaf5-eee4-46bf-a4bf-984ef9955b1e"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:31:52.936592 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:31:52.936592 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:31:52.943787 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-a221db03-8961-487e-86ff-948d91fbe6bf req-5906d4a3-4e98-4266-94ed-9cf45e2998e8 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:52.944228 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-a221db03-8961-487e-86ff-948d91fbe6bf req-5906d4a3-4e98-4266-94ed-9cf45e2998e8 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:52.956466 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-a221db03-8961-487e-86ff-948d91fbe6bf req-5906d4a3-4e98-4266-94ed-9cf45e2998e8 service nova] Creating event network-vif-deleted:fabaeaf5-eee4-46bf-a4bf-984ef9955b1e for instance a13e5623-9ecd-4036-b74a-48cbb84908de on hv-cinder-81322 Oct 12 18:31:52.962820 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-a221db03-8961-487e-86ff-948d91fbe6bf req-5906d4a3-4e98-4266-94ed-9cf45e2998e8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176004 Oct 12 18:31:52.963607 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 380/769] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:31:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:31:53.390180 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-22d5246f-05d7-45b8-b5e5-8e26a36e986f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:31:53.390866 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-22d5246f-05d7-45b8-b5e5-8e26a36e986f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:31:53.397121 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-22d5246f-05d7-45b8-b5e5-8e26a36e986f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:53.397710 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-22d5246f-05d7-45b8-b5e5-8e26a36e986f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:53.398628 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-22d5246f-05d7-45b8-b5e5-8e26a36e986f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:53.400386 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-22d5246f-05d7-45b8-b5e5-8e26a36e986f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:53.434334 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-22d5246f-05d7-45b8-b5e5-8e26a36e986f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:53.435139 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-22d5246f-05d7-45b8-b5e5-8e26a36e986f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:53.444379 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.objects.instance [None req-22d5246f-05d7-45b8-b5e5-8e26a36e986f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lazy-loading 'fault' on Instance uuid a13e5623-9ecd-4036-b74a-48cbb84908de {{(pid=109169) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:31:53.502194 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-22d5246f-05d7-45b8-b5e5-8e26a36e986f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:31:53.516096 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-22d5246f-05d7-45b8-b5e5-8e26a36e986f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:31:53.518330 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-22d5246f-05d7-45b8-b5e5-8e26a36e986f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:31:53.519477 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-22d5246f-05d7-45b8-b5e5-8e26a36e986f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 200 len: 1371 microversion: 2.20 time: 0.133162 Oct 12 18:31:53.520138 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 390/770] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:31:53 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 1371 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:31:54.539347 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-77521c8e-8c51-4cf2-9303-3c427c810d0f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:31:54.540154 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-77521c8e-8c51-4cf2-9303-3c427c810d0f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:31:54.546962 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-77521c8e-8c51-4cf2-9303-3c427c810d0f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:54.547404 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-77521c8e-8c51-4cf2-9303-3c427c810d0f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:54.548163 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-77521c8e-8c51-4cf2-9303-3c427c810d0f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:54.548616 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-77521c8e-8c51-4cf2-9303-3c427c810d0f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:54.562813 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-77521c8e-8c51-4cf2-9303-3c427c810d0f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] HTTP exception thrown: Instance a13e5623-9ecd-4036-b74a-48cbb84908de could not be found. Oct 12 18:31:54.563394 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-77521c8e-8c51-4cf2-9303-3c427c810d0f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Returning 404 to user: Instance a13e5623-9ecd-4036-b74a-48cbb84908de could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:31:54.564225 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-77521c8e-8c51-4cf2-9303-3c427c810d0f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 404 len: 111 microversion: 2.20 time: 0.029299 Oct 12 18:31:54.564802 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 381/771] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:31:54 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 18:31:54.573910 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-7515d9f1-5e79-4138-8214-80d72d2d8925 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '.version_select at 0x7fe297df9a60>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:31:54.701941 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-7515d9f1-5e79-4138-8214-80d72d2d8925 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-551042772" status: 204 len: 0 microversion: 2.20 time: 0.132235 Oct 12 18:31:54.702707 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 391/772] 10.222.0.18 () {60 vars in 1258 bytes} [Tue Oct 12 18:31:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-551042772 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 12 18:31:55.597305 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5d13857a-3ebc-4d40-9d10-56333cc40a00 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'create', calling method: .version_select at 0x7fe297d41280>, body: {"keypair": {"name": "tempest-keypair-2090729962"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:31:55.615335 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-5d13857a-3ebc-4d40-9d10-56333cc40a00 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Getting quotas for project 94cdd5201533434888e7691148b9a3a8. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:31:55.619286 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-5d13857a-3ebc-4d40-9d10-56333cc40a00 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Getting quotas for user 74acf90c734149808a501de7754b5943 and project 94cdd5201533434888e7691148b9a3a8. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:31:56.016761 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-5d13857a-3ebc-4d40-9d10-56333cc40a00 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Getting quotas for project 94cdd5201533434888e7691148b9a3a8. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:31:56.020773 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-5d13857a-3ebc-4d40-9d10-56333cc40a00 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Getting quotas for user 74acf90c734149808a501de7754b5943 and project 94cdd5201533434888e7691148b9a3a8. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:31:56.035577 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5d13857a-3ebc-4d40-9d10-56333cc40a00 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.441732 Oct 12 18:31:56.036307 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 382/773] 10.222.0.18 () {62 vars in 1198 bytes} [Tue Oct 12 18:31:55 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 443 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Oct 12 18:31:59.021536 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-4c1451cd-79c8-45f3-85da-cb144bb97781 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-710320077", "imageRef": "c79f0511-74c5-46f3-a7e6-cde6b09234ee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "80f5cd14-5950-4313-a8f0-f81c86803faa"}], "security_groups": [{"name": "tempest-securitygroup--1506886723"}], "key_name": "tempest-keypair-2090729962", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:31:59.123499 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.network.neutron [None req-4c1451cd-79c8-45f3-85da-cb144bb97781 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] validate_networks() for [('80f5cd14-5950-4313-a8f0-f81c86803faa', None, None, None, None, None)] {{(pid=109169) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 18:31:59.608883 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-4c1451cd-79c8-45f3-85da-cb144bb97781 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Flavor limits 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 18:31:59.609399 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-4c1451cd-79c8-45f3-85da-cb144bb97781 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Image limits 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 18:31:59.609977 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-4c1451cd-79c8-45f3-85da-cb144bb97781 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Flavor pref 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 18:31:59.610487 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-4c1451cd-79c8-45f3-85da-cb144bb97781 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Image pref 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 18:31:59.610970 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-4c1451cd-79c8-45f3-85da-cb144bb97781 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 18:31:59.626839 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4c1451cd-79c8-45f3-85da-cb144bb97781 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:59.626839 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4c1451cd-79c8-45f3-85da-cb144bb97781 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:59.626839 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4c1451cd-79c8-45f3-85da-cb144bb97781 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:31:59.626839 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4c1451cd-79c8-45f3-85da-cb144bb97781 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:31:59.642570 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.quota [None req-4c1451cd-79c8-45f3-85da-cb144bb97781 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Getting quotas for project 94cdd5201533434888e7691148b9a3a8. Resources: {'instances', 'cores', 'ram'} {{(pid=109169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:31:59.646427 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.quota [None req-4c1451cd-79c8-45f3-85da-cb144bb97781 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Getting quotas for user 74acf90c734149808a501de7754b5943 and project 94cdd5201533434888e7691148b9a3a8. Resources: {'instances', 'cores', 'ram'} {{(pid=109169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:31:59.657134 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-4c1451cd-79c8-45f3-85da-cb144bb97781 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Going to run 1 instances... {{(pid=109169) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 18:31:59.659436 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-4c1451cd-79c8-45f3-85da-cb144bb97781 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c79f0511-74c5-46f3-a7e6-cde6b09234ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109169) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 18:31:59.810486 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-4c1451cd-79c8-45f3-85da-cb144bb97781 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.793143 Oct 12 18:31:59.811419 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 392/774] 10.222.0.18 () {62 vars in 1187 bytes} [Tue Oct 12 18:31:59 2021] POST /compute/v2.1/servers => generated 402 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 18:31:59.822045 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5719920b-ad46-4637-9d13-0a67c397ea6b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:31:59.822664 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5719920b-ad46-4637-9d13-0a67c397ea6b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:31:59.876122 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5719920b-ad46-4637-9d13-0a67c397ea6b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:31:59.883225 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5719920b-ad46-4637-9d13-0a67c397ea6b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:31:59.884789 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5719920b-ad46-4637-9d13-0a67c397ea6b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:31:59.886458 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5719920b-ad46-4637-9d13-0a67c397ea6b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1281 microversion: 2.20 time: 0.068000 Oct 12 18:31:59.887024 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 383/775] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:31:59 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1281 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:32:00.905911 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-a9d92f30-3b68-4eaa-a591-868e5aa884d9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:00.906528 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-a9d92f30-3b68-4eaa-a591-868e5aa884d9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:00.958924 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-a9d92f30-3b68-4eaa-a591-868e5aa884d9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:00.967926 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-a9d92f30-3b68-4eaa-a591-868e5aa884d9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:00.970729 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-a9d92f30-3b68-4eaa-a591-868e5aa884d9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:00.970729 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-a9d92f30-3b68-4eaa-a591-868e5aa884d9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1281 microversion: 2.20 time: 0.069308 Oct 12 18:32:00.971179 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 393/776] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:32:00 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1281 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:32:01.991994 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-63ec4c95-6268-4c8e-bbab-2d1720ab3a2c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:01.992816 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-63ec4c95-6268-4c8e-bbab-2d1720ab3a2c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:02.051117 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-63ec4c95-6268-4c8e-bbab-2d1720ab3a2c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:02.058652 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-63ec4c95-6268-4c8e-bbab-2d1720ab3a2c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:02.060489 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-63ec4c95-6268-4c8e-bbab-2d1720ab3a2c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:02.061559 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-63ec4c95-6268-4c8e-bbab-2d1720ab3a2c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1281 microversion: 2.20 time: 0.075900 Oct 12 18:32:02.062097 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 384/777] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:32:01 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:32:03.079565 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-8916f902-29ed-4e1a-b9b9-f041a1e035b5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:03.080202 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-8916f902-29ed-4e1a-b9b9-f041a1e035b5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:03.133787 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-8916f902-29ed-4e1a-b9b9-f041a1e035b5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:03.140957 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-8916f902-29ed-4e1a-b9b9-f041a1e035b5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:03.142438 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-8916f902-29ed-4e1a-b9b9-f041a1e035b5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:03.143511 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-8916f902-29ed-4e1a-b9b9-f041a1e035b5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1281 microversion: 2.20 time: 0.067993 Oct 12 18:32:03.144059 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 394/778] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:32:03 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1281 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:32:04.161984 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1cb7430e-091a-4218-935d-40ae0f236508 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:04.162576 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1cb7430e-091a-4218-935d-40ae0f236508 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:04.168927 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1cb7430e-091a-4218-935d-40ae0f236508 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:04.169445 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1cb7430e-091a-4218-935d-40ae0f236508 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:04.170220 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1cb7430e-091a-4218-935d-40ae0f236508 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:04.170644 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1cb7430e-091a-4218-935d-40ae0f236508 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:04.233002 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1cb7430e-091a-4218-935d-40ae0f236508 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:04.243014 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1cb7430e-091a-4218-935d-40ae0f236508 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:04.243014 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1cb7430e-091a-4218-935d-40ae0f236508 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:04.243825 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1cb7430e-091a-4218-935d-40ae0f236508 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1285 microversion: 2.20 time: 0.085583 Oct 12 18:32:04.244365 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 385/779] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:32:04 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:32:04.561625 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-179fc035-8dca-49f1-9bf1-5a43185a62c1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:04.562610 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-179fc035-8dca-49f1-9bf1-5a43185a62c1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:04.568881 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-179fc035-8dca-49f1-9bf1-5a43185a62c1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:04.569193 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-179fc035-8dca-49f1-9bf1-5a43185a62c1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:04.569967 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-179fc035-8dca-49f1-9bf1-5a43185a62c1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:04.570398 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-179fc035-8dca-49f1-9bf1-5a43185a62c1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:04.600595 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-179fc035-8dca-49f1-9bf1-5a43185a62c1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043201 Oct 12 18:32:04.601160 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 395/780] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Oct 12 18:32:04 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 18:32:04.658636 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-191d3fb6-fc1a-4957-b2fe-d1b658a9edc4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:04.659132 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-191d3fb6-fc1a-4957-b2fe-d1b658a9edc4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:04.665036 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-191d3fb6-fc1a-4957-b2fe-d1b658a9edc4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:04.665616 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-191d3fb6-fc1a-4957-b2fe-d1b658a9edc4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:04.666259 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-191d3fb6-fc1a-4957-b2fe-d1b658a9edc4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:04.667208 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-191d3fb6-fc1a-4957-b2fe-d1b658a9edc4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:04.697532 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-191d3fb6-fc1a-4957-b2fe-d1b658a9edc4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Going to try to terminate instance {{(pid=109168) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 18:32:05.002210 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-191d3fb6-fc1a-4957-b2fe-d1b658a9edc4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 204 len: 0 microversion: 2.1 time: 0.346907 Oct 12 18:32:05.002689 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 386/781] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Oct 12 18:32:04 2021] DELETE /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 18:32:05.010792 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-6c070ff6-6267-49e5-82f4-cf4401177485 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:05.011400 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-6c070ff6-6267-49e5-82f4-cf4401177485 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:05.017339 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6c070ff6-6267-49e5-82f4-cf4401177485 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:05.017781 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6c070ff6-6267-49e5-82f4-cf4401177485 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:05.018539 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6c070ff6-6267-49e5-82f4-cf4401177485 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:05.018970 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6c070ff6-6267-49e5-82f4-cf4401177485 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:05.145179 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-6c070ff6-6267-49e5-82f4-cf4401177485 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:05.153032 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-6c070ff6-6267-49e5-82f4-cf4401177485 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1674 microversion: 2.1 time: 0.145972 Oct 12 18:32:05.153952 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 396/782] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:05 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:32:05.262945 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-17ffcdb3-4cee-4da3-b6ff-14766db08113 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:05.263725 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-17ffcdb3-4cee-4da3-b6ff-14766db08113 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:05.269632 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-17ffcdb3-4cee-4da3-b6ff-14766db08113 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:05.270167 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-17ffcdb3-4cee-4da3-b6ff-14766db08113 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:05.275197 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-17ffcdb3-4cee-4da3-b6ff-14766db08113 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:05.275197 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-17ffcdb3-4cee-4da3-b6ff-14766db08113 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:05.339256 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-17ffcdb3-4cee-4da3-b6ff-14766db08113 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:05.347049 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-17ffcdb3-4cee-4da3-b6ff-14766db08113 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:05.348621 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-17ffcdb3-4cee-4da3-b6ff-14766db08113 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:05.349716 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-17ffcdb3-4cee-4da3-b6ff-14766db08113 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1285 microversion: 2.20 time: 0.092070 Oct 12 18:32:05.350266 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 387/783] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:32:05 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:32:06.170658 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-fc736b8e-7ddd-4a72-8e29-b5e0a9c34f14 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:06.171313 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-fc736b8e-7ddd-4a72-8e29-b5e0a9c34f14 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:06.177331 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fc736b8e-7ddd-4a72-8e29-b5e0a9c34f14 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:06.177768 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fc736b8e-7ddd-4a72-8e29-b5e0a9c34f14 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:06.178539 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fc736b8e-7ddd-4a72-8e29-b5e0a9c34f14 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:06.178969 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fc736b8e-7ddd-4a72-8e29-b5e0a9c34f14 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:06.368748 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-17032caa-2001-45cd-96a3-d079b148b09b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:06.368748 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-17032caa-2001-45cd-96a3-d079b148b09b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:06.377544 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-17032caa-2001-45cd-96a3-d079b148b09b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:06.377983 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-17032caa-2001-45cd-96a3-d079b148b09b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:06.378952 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-17032caa-2001-45cd-96a3-d079b148b09b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:06.379435 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-17032caa-2001-45cd-96a3-d079b148b09b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:06.475945 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-fc736b8e-7ddd-4a72-8e29-b5e0a9c34f14 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:06.479702 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-17032caa-2001-45cd-96a3-d079b148b09b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:06.483618 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-fc736b8e-7ddd-4a72-8e29-b5e0a9c34f14 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1674 microversion: 2.1 time: 0.317018 Oct 12 18:32:06.484205 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 397/784] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:06 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1674 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:32:06.497522 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-17032caa-2001-45cd-96a3-d079b148b09b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:06.499586 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-17032caa-2001-45cd-96a3-d079b148b09b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:06.500818 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-17032caa-2001-45cd-96a3-d079b148b09b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1341 microversion: 2.20 time: 0.137101 Oct 12 18:32:06.501597 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 388/785] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:32:06 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1341 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:32:07.508332 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-7bde0ec0-541e-4b11-a0cc-d1804c3157b6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:07.509078 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-7bde0ec0-541e-4b11-a0cc-d1804c3157b6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:07.515719 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7bde0ec0-541e-4b11-a0cc-d1804c3157b6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:07.516159 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7bde0ec0-541e-4b11-a0cc-d1804c3157b6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:07.516989 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7bde0ec0-541e-4b11-a0cc-d1804c3157b6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:07.517534 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7bde0ec0-541e-4b11-a0cc-d1804c3157b6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:07.519863 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2dc9720a-39d6-4155-b1ff-88831f8aa30d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:07.521078 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2dc9720a-39d6-4155-b1ff-88831f8aa30d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:07.529644 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2dc9720a-39d6-4155-b1ff-88831f8aa30d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:07.530177 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2dc9720a-39d6-4155-b1ff-88831f8aa30d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:07.531078 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2dc9720a-39d6-4155-b1ff-88831f8aa30d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:07.531586 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2dc9720a-39d6-4155-b1ff-88831f8aa30d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:07.649583 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-7bde0ec0-541e-4b11-a0cc-d1804c3157b6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:07.657434 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-7bde0ec0-541e-4b11-a0cc-d1804c3157b6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1607 microversion: 2.1 time: 0.153222 Oct 12 18:32:07.658027 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 398/786] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:07 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1607 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:32:07.823130 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2dc9720a-39d6-4155-b1ff-88831f8aa30d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:07.840563 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2dc9720a-39d6-4155-b1ff-88831f8aa30d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:07.842292 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2dc9720a-39d6-4155-b1ff-88831f8aa30d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:07.843541 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2dc9720a-39d6-4155-b1ff-88831f8aa30d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1407 microversion: 2.20 time: 0.327348 Oct 12 18:32:07.844226 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 389/787] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:32:07 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1407 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:32:07.944041 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-fef4845a-8b17-4be5-a094-b3571b5c3eb4 req-ffb6604c-e4ba-412b-90bf-02e67dc18b51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ad61db5-995d-47f1-a6d6-891628733252", "name": "network-vif-deleted", "tag": "e09e7894-b521-40f8-ae1f-7364d6e573c9"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:07.945556 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:32:07.945556 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:32:07.953293 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-fef4845a-8b17-4be5-a094-b3571b5c3eb4 req-ffb6604c-e4ba-412b-90bf-02e67dc18b51 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:07.953819 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-fef4845a-8b17-4be5-a094-b3571b5c3eb4 req-ffb6604c-e4ba-412b-90bf-02e67dc18b51 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:07.965937 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-fef4845a-8b17-4be5-a094-b3571b5c3eb4 req-ffb6604c-e4ba-412b-90bf-02e67dc18b51 service nova] Creating event network-vif-deleted:e09e7894-b521-40f8-ae1f-7364d6e573c9 for instance 1ad61db5-995d-47f1-a6d6-891628733252 on hv-cinder-81322 Oct 12 18:32:07.971490 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-fef4845a-8b17-4be5-a094-b3571b5c3eb4 req-ffb6604c-e4ba-412b-90bf-02e67dc18b51 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032045 Oct 12 18:32:07.972249 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 399/788] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:32:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:32:08.686342 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-996f52a6-5860-427b-83d4-6da4b693eb3b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:08.687089 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-996f52a6-5860-427b-83d4-6da4b693eb3b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:08.693046 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-996f52a6-5860-427b-83d4-6da4b693eb3b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:08.693490 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-996f52a6-5860-427b-83d4-6da4b693eb3b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:08.694271 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-996f52a6-5860-427b-83d4-6da4b693eb3b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:08.694704 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-996f52a6-5860-427b-83d4-6da4b693eb3b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:08.765849 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-996f52a6-5860-427b-83d4-6da4b693eb3b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:08.774971 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-996f52a6-5860-427b-83d4-6da4b693eb3b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1607 microversion: 2.1 time: 0.092087 Oct 12 18:32:08.774971 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 390/789] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:08 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1607 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:08.863259 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-3d6368ca-b5b8-491b-bb45-a05ee06261f0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:08.863953 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-3d6368ca-b5b8-491b-bb45-a05ee06261f0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:08.870591 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3d6368ca-b5b8-491b-bb45-a05ee06261f0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:08.870953 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3d6368ca-b5b8-491b-bb45-a05ee06261f0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:08.871881 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3d6368ca-b5b8-491b-bb45-a05ee06261f0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:08.872127 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3d6368ca-b5b8-491b-bb45-a05ee06261f0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:09.097342 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-3d6368ca-b5b8-491b-bb45-a05ee06261f0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:09.106330 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-3d6368ca-b5b8-491b-bb45-a05ee06261f0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:09.107918 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-3d6368ca-b5b8-491b-bb45-a05ee06261f0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:09.113115 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-3d6368ca-b5b8-491b-bb45-a05ee06261f0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1407 microversion: 2.20 time: 0.250193 Oct 12 18:32:09.113115 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 400/790] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:32:08 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:32:09.244117 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3df30ab4-3d31-40fb-8305-f7c242405d01 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:09.245567 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3df30ab4-3d31-40fb-8305-f7c242405d01 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:09.251503 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3df30ab4-3d31-40fb-8305-f7c242405d01 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:09.254366 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3df30ab4-3d31-40fb-8305-f7c242405d01 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:09.254366 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3df30ab4-3d31-40fb-8305-f7c242405d01 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:09.254366 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3df30ab4-3d31-40fb-8305-f7c242405d01 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:09.278804 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3df30ab4-3d31-40fb-8305-f7c242405d01 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Going to try to terminate instance {{(pid=109168) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 18:32:09.560337 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3df30ab4-3d31-40fb-8305-f7c242405d01 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 204 len: 0 microversion: 2.1 time: 0.320309 Oct 12 18:32:09.560969 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 391/791] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Oct 12 18:32:09 2021] DELETE /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 18:32:09.571963 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-98701a9e-8a98-469f-a1b9-b04097ef8794 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:09.573589 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-98701a9e-8a98-469f-a1b9-b04097ef8794 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:09.583979 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-98701a9e-8a98-469f-a1b9-b04097ef8794 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:09.584673 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-98701a9e-8a98-469f-a1b9-b04097ef8794 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:09.585585 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-98701a9e-8a98-469f-a1b9-b04097ef8794 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:09.586522 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-98701a9e-8a98-469f-a1b9-b04097ef8794 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:09.768993 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-98701a9e-8a98-469f-a1b9-b04097ef8794 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:09.775243 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-98701a9e-8a98-469f-a1b9-b04097ef8794 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1575 microversion: 2.1 time: 0.209620 Oct 12 18:32:09.775864 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 401/792] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:09 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1575 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:09.793367 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-65d524fc-4e9a-4f43-9583-979944919ef9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:09.794166 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-65d524fc-4e9a-4f43-9583-979944919ef9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:09.799996 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-65d524fc-4e9a-4f43-9583-979944919ef9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:09.800480 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-65d524fc-4e9a-4f43-9583-979944919ef9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:09.801278 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-65d524fc-4e9a-4f43-9583-979944919ef9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:09.801716 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-65d524fc-4e9a-4f43-9583-979944919ef9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:09.881085 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-65d524fc-4e9a-4f43-9583-979944919ef9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:09.890617 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-65d524fc-4e9a-4f43-9583-979944919ef9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1323 microversion: 2.1 time: 0.101821 Oct 12 18:32:09.891389 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 392/793] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:09 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1323 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:09.987747 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-a1f4d771-630b-4da6-9890-eb15ee1e9de8 req-d46cd434-42d1-4277-ab57-315203738487 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a73458df-c845-4c48-9839-58d3acdfd4da", "tag": "6b4b7683-8980-4bd3-9e9f-66f9276cb054"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:09.989328 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:32:09.989328 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:32:09.997490 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-a1f4d771-630b-4da6-9890-eb15ee1e9de8 req-d46cd434-42d1-4277-ab57-315203738487 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:09.997921 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-a1f4d771-630b-4da6-9890-eb15ee1e9de8 req-d46cd434-42d1-4277-ab57-315203738487 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:10.009672 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-a1f4d771-630b-4da6-9890-eb15ee1e9de8 req-d46cd434-42d1-4277-ab57-315203738487 service nova] Creating event network-changed:6b4b7683-8980-4bd3-9e9f-66f9276cb054 for instance a73458df-c845-4c48-9839-58d3acdfd4da on hv-cinder-81322 Oct 12 18:32:10.014711 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-a1f4d771-630b-4da6-9890-eb15ee1e9de8 req-d46cd434-42d1-4277-ab57-315203738487 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030587 Oct 12 18:32:10.015640 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 402/794] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:32:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:32:10.127939 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d7288fc4-1afc-4599-b756-56ec2a7cc12d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:10.128479 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d7288fc4-1afc-4599-b756-56ec2a7cc12d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:10.134438 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d7288fc4-1afc-4599-b756-56ec2a7cc12d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:10.134878 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d7288fc4-1afc-4599-b756-56ec2a7cc12d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:10.135638 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d7288fc4-1afc-4599-b756-56ec2a7cc12d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:10.136063 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d7288fc4-1afc-4599-b756-56ec2a7cc12d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:10.268012 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d7288fc4-1afc-4599-b756-56ec2a7cc12d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:10.276483 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d7288fc4-1afc-4599-b756-56ec2a7cc12d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:10.277987 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d7288fc4-1afc-4599-b756-56ec2a7cc12d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:10.279360 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d7288fc4-1afc-4599-b756-56ec2a7cc12d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1407 microversion: 2.20 time: 0.155208 Oct 12 18:32:10.279923 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 393/795] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:32:10 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:32:10.794094 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-757d24fe-aac1-4f0b-ba7d-1f4e2f3e421a tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:10.794825 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-757d24fe-aac1-4f0b-ba7d-1f4e2f3e421a tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:10.800906 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-757d24fe-aac1-4f0b-ba7d-1f4e2f3e421a tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:10.801346 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-757d24fe-aac1-4f0b-ba7d-1f4e2f3e421a tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:10.802109 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-757d24fe-aac1-4f0b-ba7d-1f4e2f3e421a tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:10.807775 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-757d24fe-aac1-4f0b-ba7d-1f4e2f3e421a tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:10.907705 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-89b8f407-68bb-458e-9a3f-4fc9e839e730 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:10.908454 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-89b8f407-68bb-458e-9a3f-4fc9e839e730 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:10.914861 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-89b8f407-68bb-458e-9a3f-4fc9e839e730 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:10.920170 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-89b8f407-68bb-458e-9a3f-4fc9e839e730 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:10.920170 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-89b8f407-68bb-458e-9a3f-4fc9e839e730 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:10.920170 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-89b8f407-68bb-458e-9a3f-4fc9e839e730 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:10.948604 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-89b8f407-68bb-458e-9a3f-4fc9e839e730 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:10.949050 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-89b8f407-68bb-458e-9a3f-4fc9e839e730 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:10.949499 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-89b8f407-68bb-458e-9a3f-4fc9e839e730 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lazy-loading 'fault' on Instance uuid 1ad61db5-995d-47f1-a6d6-891628733252 {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:32:11.001098 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-89b8f407-68bb-458e-9a3f-4fc9e839e730 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:11.008606 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-757d24fe-aac1-4f0b-ba7d-1f4e2f3e421a tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:11.009140 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-89b8f407-68bb-458e-9a3f-4fc9e839e730 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 200 len: 1328 microversion: 2.1 time: 0.104615 Oct 12 18:32:11.009727 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 394/796] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:10 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 1328 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:32:11.022722 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-757d24fe-aac1-4f0b-ba7d-1f4e2f3e421a tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1575 microversion: 2.1 time: 0.232615 Oct 12 18:32:11.023301 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 403/797] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:10 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1575 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:32:11.297866 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-584d0c2c-a197-4362-ac6b-dbd148cc810c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:11.298702 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-584d0c2c-a197-4362-ac6b-dbd148cc810c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:11.305482 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-584d0c2c-a197-4362-ac6b-dbd148cc810c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:11.306255 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-584d0c2c-a197-4362-ac6b-dbd148cc810c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:11.307629 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-584d0c2c-a197-4362-ac6b-dbd148cc810c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:11.308260 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-584d0c2c-a197-4362-ac6b-dbd148cc810c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:11.603506 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-584d0c2c-a197-4362-ac6b-dbd148cc810c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:11.614314 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-584d0c2c-a197-4362-ac6b-dbd148cc810c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:11.616727 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-584d0c2c-a197-4362-ac6b-dbd148cc810c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:11.628840 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-584d0c2c-a197-4362-ac6b-dbd148cc810c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1407 microversion: 2.20 time: 0.324056 Oct 12 18:32:11.628840 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 395/798] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:32:11 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1407 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:32:12.027573 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-010afe86-f71e-4475-849d-15dff9c08b8e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:12.028983 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-010afe86-f71e-4475-849d-15dff9c08b8e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:12.034812 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-010afe86-f71e-4475-849d-15dff9c08b8e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:12.035261 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-010afe86-f71e-4475-849d-15dff9c08b8e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:12.036031 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-010afe86-f71e-4475-849d-15dff9c08b8e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:12.036482 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-010afe86-f71e-4475-849d-15dff9c08b8e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:12.040454 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a429eb0c-84b8-469d-85da-670e760a88a4 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:12.041068 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a429eb0c-84b8-469d-85da-670e760a88a4 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:12.047085 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a429eb0c-84b8-469d-85da-670e760a88a4 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:12.047530 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a429eb0c-84b8-469d-85da-670e760a88a4 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:12.048490 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a429eb0c-84b8-469d-85da-670e760a88a4 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:12.049079 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a429eb0c-84b8-469d-85da-670e760a88a4 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:12.051240 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.wsgi [None req-010afe86-f71e-4475-849d-15dff9c08b8e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] HTTP exception thrown: Instance 1ad61db5-995d-47f1-a6d6-891628733252 could not be found. Oct 12 18:32:12.051822 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-010afe86-f71e-4475-849d-15dff9c08b8e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Returning 404 to user: Instance 1ad61db5-995d-47f1-a6d6-891628733252 could not be found. {{(pid=109169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:32:12.052669 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-010afe86-f71e-4475-849d-15dff9c08b8e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 404 len: 111 microversion: 2.1 time: 0.029632 Oct 12 18:32:12.053220 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 404/799] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:12 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:32:12.063342 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-5e0d85c5-8fe3-44d5-9999-1d2e5f15675c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '.version_select at 0x7fe297f438b0>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:12.151500 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-5e0d85c5-8fe3-44d5-9999-1d2e5f15675c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1327013034" status: 202 len: 0 microversion: 2.1 time: 0.091170 Oct 12 18:32:12.152078 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 405/800] 10.222.0.18 () {58 vars in 1220 bytes} [Tue Oct 12 18:32:12 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1327013034 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:32:12.192491 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a429eb0c-84b8-469d-85da-670e760a88a4 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:12.200349 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a429eb0c-84b8-469d-85da-670e760a88a4 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1575 microversion: 2.1 time: 0.163560 Oct 12 18:32:12.200972 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 396/801] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:12 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:12.639242 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-e2e7a507-dd3b-48b9-8b7b-6308e946c80b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:12.639842 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-e2e7a507-dd3b-48b9-8b7b-6308e946c80b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:12.645730 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e2e7a507-dd3b-48b9-8b7b-6308e946c80b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:12.646415 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e2e7a507-dd3b-48b9-8b7b-6308e946c80b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:12.647182 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e2e7a507-dd3b-48b9-8b7b-6308e946c80b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:12.647947 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e2e7a507-dd3b-48b9-8b7b-6308e946c80b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:12.897893 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-e2e7a507-dd3b-48b9-8b7b-6308e946c80b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:12.906481 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-e2e7a507-dd3b-48b9-8b7b-6308e946c80b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:12.908102 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-e2e7a507-dd3b-48b9-8b7b-6308e946c80b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:12.909347 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-e2e7a507-dd3b-48b9-8b7b-6308e946c80b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1407 microversion: 2.20 time: 0.274552 Oct 12 18:32:12.909910 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 406/802] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:32:12 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1407 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:32:13.090880 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-afbf2fc5-88eb-4255-8621-91c6e5f6d562 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'create', calling method: .version_select at 0x7fe297d85310>, body: {"keypair": {"name": "tempest-keypair-381517377"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:13.111647 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-afbf2fc5-88eb-4255-8621-91c6e5f6d562 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Getting quotas for project ee04649277c84912b20967b31162615b. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:32:13.116064 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-afbf2fc5-88eb-4255-8621-91c6e5f6d562 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Getting quotas for user 835bbb43ae5f48bfa14b22cb0a47cb4e and project ee04649277c84912b20967b31162615b. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:32:13.223198 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-8a9f037c-90f1-4ebe-be81-1a1aa2e44883 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:13.224916 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-8a9f037c-90f1-4ebe-be81-1a1aa2e44883 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:13.232650 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8a9f037c-90f1-4ebe-be81-1a1aa2e44883 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:13.233106 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8a9f037c-90f1-4ebe-be81-1a1aa2e44883 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:13.233891 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8a9f037c-90f1-4ebe-be81-1a1aa2e44883 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:13.234328 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8a9f037c-90f1-4ebe-be81-1a1aa2e44883 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:13.327952 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-8a9f037c-90f1-4ebe-be81-1a1aa2e44883 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:13.335821 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-8a9f037c-90f1-4ebe-be81-1a1aa2e44883 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1507 microversion: 2.1 time: 0.116312 Oct 12 18:32:13.336715 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 407/803] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:13 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1507 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:13.481114 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-c1a30a62-79c9-4aca-9b4a-7826d25a1ed7 req-29561cc1-43a2-4adf-a0ac-e2e9facd47bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff8be5be-6f8c-42e2-9cd4-10c62915f993", "name": "network-vif-deleted", "tag": "e9e1d074-c7de-4406-9644-edcd2e1b0059"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:13.483450 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:32:13.483450 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:32:13.493813 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-c1a30a62-79c9-4aca-9b4a-7826d25a1ed7 req-29561cc1-43a2-4adf-a0ac-e2e9facd47bb service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:13.497818 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-c1a30a62-79c9-4aca-9b4a-7826d25a1ed7 req-29561cc1-43a2-4adf-a0ac-e2e9facd47bb service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:13.512985 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-c1a30a62-79c9-4aca-9b4a-7826d25a1ed7 req-29561cc1-43a2-4adf-a0ac-e2e9facd47bb service nova] Creating event network-vif-deleted:e9e1d074-c7de-4406-9644-edcd2e1b0059 for instance ff8be5be-6f8c-42e2-9cd4-10c62915f993 on hv-cinder-81322 Oct 12 18:32:13.520750 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-c1a30a62-79c9-4aca-9b4a-7826d25a1ed7 req-29561cc1-43a2-4adf-a0ac-e2e9facd47bb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052190 Oct 12 18:32:13.521708 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 408/804] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:32:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 18:32:13.716985 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-afbf2fc5-88eb-4255-8621-91c6e5f6d562 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Getting quotas for project ee04649277c84912b20967b31162615b. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:32:13.721709 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-afbf2fc5-88eb-4255-8621-91c6e5f6d562 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Getting quotas for user 835bbb43ae5f48bfa14b22cb0a47cb4e and project ee04649277c84912b20967b31162615b. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:32:13.738276 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-afbf2fc5-88eb-4255-8621-91c6e5f6d562 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.651469 Oct 12 18:32:13.738895 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 397/805] 10.222.0.18 () {60 vars in 1157 bytes} [Tue Oct 12 18:32:13 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:13.931050 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-85fdd7f2-5ef7-412c-bb8c-64896efa6475 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:13.931817 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-85fdd7f2-5ef7-412c-bb8c-64896efa6475 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:13.938642 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-85fdd7f2-5ef7-412c-bb8c-64896efa6475 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:13.939093 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-85fdd7f2-5ef7-412c-bb8c-64896efa6475 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:13.939941 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-85fdd7f2-5ef7-412c-bb8c-64896efa6475 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:13.940610 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-85fdd7f2-5ef7-412c-bb8c-64896efa6475 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:14.102039 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-85fdd7f2-5ef7-412c-bb8c-64896efa6475 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:14.110798 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-85fdd7f2-5ef7-412c-bb8c-64896efa6475 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:14.112299 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-85fdd7f2-5ef7-412c-bb8c-64896efa6475 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:14.113442 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-85fdd7f2-5ef7-412c-bb8c-64896efa6475 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1407 microversion: 2.20 time: 0.187615 Oct 12 18:32:14.114106 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 409/806] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:32:13 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:32:14.355090 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-89485122-3258-4210-a591-27805953bc9d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:14.355699 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-89485122-3258-4210-a591-27805953bc9d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:14.361772 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-89485122-3258-4210-a591-27805953bc9d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:14.362211 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-89485122-3258-4210-a591-27805953bc9d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:14.362982 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-89485122-3258-4210-a591-27805953bc9d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:14.363407 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-89485122-3258-4210-a591-27805953bc9d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:14.406199 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-89485122-3258-4210-a591-27805953bc9d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:14.406869 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-89485122-3258-4210-a591-27805953bc9d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:14.407421 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-89485122-3258-4210-a591-27805953bc9d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lazy-loading 'fault' on Instance uuid ff8be5be-6f8c-42e2-9cd4-10c62915f993 {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:32:14.461164 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-89485122-3258-4210-a591-27805953bc9d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:14.469925 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-89485122-3258-4210-a591-27805953bc9d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 200 len: 1228 microversion: 2.1 time: 0.118595 Oct 12 18:32:14.470491 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 398/807] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:14 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 1228 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:15.130906 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-b1b41187-7b11-4cb9-9899-1eaac96ee137 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:15.131507 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-b1b41187-7b11-4cb9-9899-1eaac96ee137 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:15.137758 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b1b41187-7b11-4cb9-9899-1eaac96ee137 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:15.138190 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b1b41187-7b11-4cb9-9899-1eaac96ee137 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:15.138961 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b1b41187-7b11-4cb9-9899-1eaac96ee137 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:15.139384 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b1b41187-7b11-4cb9-9899-1eaac96ee137 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:15.279705 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-b1b41187-7b11-4cb9-9899-1eaac96ee137 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:15.280787 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-03722798-8ebe-4c3a-b319-9024f827abf3 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:15.281554 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-03722798-8ebe-4c3a-b319-9024f827abf3 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:15.287660 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-03722798-8ebe-4c3a-b319-9024f827abf3 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:15.288584 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-03722798-8ebe-4c3a-b319-9024f827abf3 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:15.289143 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-b1b41187-7b11-4cb9-9899-1eaac96ee137 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:15.289491 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-03722798-8ebe-4c3a-b319-9024f827abf3 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:15.289996 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-03722798-8ebe-4c3a-b319-9024f827abf3 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:15.290660 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-b1b41187-7b11-4cb9-9899-1eaac96ee137 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:15.292335 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-b1b41187-7b11-4cb9-9899-1eaac96ee137 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1407 microversion: 2.20 time: 0.165160 Oct 12 18:32:15.293533 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 410/808] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:32:15 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:32:15.316288 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-03722798-8ebe-4c3a-b319-9024f827abf3 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lazy-loading 'flavor' on Instance uuid 1f0cf04d-323c-4749-b9ae-d35333eb565c {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:32:15.486154 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-83a017dd-e8b5-4330-9e39-5d402789d20b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:15.486755 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-83a017dd-e8b5-4330-9e39-5d402789d20b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:15.492621 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-83a017dd-e8b5-4330-9e39-5d402789d20b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:15.493068 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-83a017dd-e8b5-4330-9e39-5d402789d20b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:15.493842 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-83a017dd-e8b5-4330-9e39-5d402789d20b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:15.494829 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-83a017dd-e8b5-4330-9e39-5d402789d20b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:15.515075 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.wsgi [None req-83a017dd-e8b5-4330-9e39-5d402789d20b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] HTTP exception thrown: Instance ff8be5be-6f8c-42e2-9cd4-10c62915f993 could not be found. Oct 12 18:32:15.515782 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-83a017dd-e8b5-4330-9e39-5d402789d20b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Returning 404 to user: Instance ff8be5be-6f8c-42e2-9cd4-10c62915f993 could not be found. {{(pid=109169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:32:15.516881 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-83a017dd-e8b5-4330-9e39-5d402789d20b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 404 len: 111 microversion: 2.1 time: 0.034390 Oct 12 18:32:15.517663 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 411/809] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:15 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 18:32:15.595020 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-03722798-8ebe-4c3a-b319-9024f827abf3 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "POST /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c/action" status: 202 len: 0 microversion: 2.1 time: 0.318258 Oct 12 18:32:15.596331 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 399/810] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:32:15 2021] POST /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:32:15.614005 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-eff1b808-74fd-424d-905d-446937d884fd tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:15.614641 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-eff1b808-74fd-424d-905d-446937d884fd tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:15.633232 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-eff1b808-74fd-424d-905d-446937d884fd tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:15.633742 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-eff1b808-74fd-424d-905d-446937d884fd tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:15.634558 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-eff1b808-74fd-424d-905d-446937d884fd tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:15.635659 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-eff1b808-74fd-424d-905d-446937d884fd tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:15.654872 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9000c8b2-ef5a-474a-8a16-53ed02a4cdac tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1481124474", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-800000789", "security_groups": [{"name": "tempest-secgroup-smoke-1773849625"}], "block_device_mapping_v2": [{"uuid": "776af31a-a23a-4141-b64b-fdc3070d18fd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "61bc6454-3943-4ea7-a052-57599eadac06"}]}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:15.812264 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.network.neutron [None req-9000c8b2-ef5a-474a-8a16-53ed02a4cdac tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] validate_networks() for [('61bc6454-3943-4ea7-a052-57599eadac06', None, None, None, None, None)] {{(pid=109168) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 18:32:15.817233 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-eff1b808-74fd-424d-905d-446937d884fd tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:15.825265 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-eff1b808-74fd-424d-905d-446937d884fd tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1569 microversion: 2.1 time: 0.221992 Oct 12 18:32:15.825843 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 412/811] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:15 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1569 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:32:16.311669 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-67acc7df-f7ce-4c88-90f2-0710699ea2d6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:16.312448 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-67acc7df-f7ce-4c88-90f2-0710699ea2d6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:16.321107 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-67acc7df-f7ce-4c88-90f2-0710699ea2d6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:16.322109 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-67acc7df-f7ce-4c88-90f2-0710699ea2d6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:16.323167 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-67acc7df-f7ce-4c88-90f2-0710699ea2d6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:16.323832 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-67acc7df-f7ce-4c88-90f2-0710699ea2d6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:16.418635 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-9000c8b2-ef5a-474a-8a16-53ed02a4cdac tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Flavor limits 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 18:32:16.419125 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-9000c8b2-ef5a-474a-8a16-53ed02a4cdac tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Image limits 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 18:32:16.419706 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-9000c8b2-ef5a-474a-8a16-53ed02a4cdac tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Flavor pref 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 18:32:16.420287 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-9000c8b2-ef5a-474a-8a16-53ed02a4cdac tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Image pref 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 18:32:16.420792 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-9000c8b2-ef5a-474a-8a16-53ed02a4cdac tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 18:32:16.429514 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9000c8b2-ef5a-474a-8a16-53ed02a4cdac tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:16.430020 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9000c8b2-ef5a-474a-8a16-53ed02a4cdac tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:16.430827 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9000c8b2-ef5a-474a-8a16-53ed02a4cdac tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:16.431461 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9000c8b2-ef5a-474a-8a16-53ed02a4cdac tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:16.457732 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-9000c8b2-ef5a-474a-8a16-53ed02a4cdac tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Getting quotas for project d1b808c36ccd4256858530aedc0a6f64. Resources: {'instances', 'cores', 'ram'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:32:16.462556 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-9000c8b2-ef5a-474a-8a16-53ed02a4cdac tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Getting quotas for user 9a37985dd5034ceeabfa47797efba5a1 and project d1b808c36ccd4256858530aedc0a6f64. Resources: {'instances', 'cores', 'ram'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:32:16.500587 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-67acc7df-f7ce-4c88-90f2-0710699ea2d6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:16.507728 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-67acc7df-f7ce-4c88-90f2-0710699ea2d6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:16.509471 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-67acc7df-f7ce-4c88-90f2-0710699ea2d6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:16.511121 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-67acc7df-f7ce-4c88-90f2-0710699ea2d6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1407 microversion: 2.20 time: 0.203790 Oct 12 18:32:16.511693 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 413/812] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:32:16 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:32:16.516381 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-bea14af5-58b3-44cf-90b5-66aac7fbf7b4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1755948697", "imageRef": "c79f0511-74c5-46f3-a7e6-cde6b09234ee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c28011f7-a600-4bea-98eb-e6748c99ba11"}], "security_groups": [{"name": "tempest-securitygroup--1301512783"}], "key_name": "tempest-keypair-381517377", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:16.527651 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9000c8b2-ef5a-474a-8a16-53ed02a4cdac tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Going to run 1 instances... {{(pid=109168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 18:32:16.530447 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9000c8b2-ef5a-474a-8a16-53ed02a4cdac tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 527d2718-c3be-44f9-bf49-9c445e98cc75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='776af31a-a23a-4141-b64b-fdc3070d18fd',volume_size=None,volume_type=None)] {{(pid=109168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 18:32:16.612151 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.network.neutron [None req-bea14af5-58b3-44cf-90b5-66aac7fbf7b4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] validate_networks() for [('c28011f7-a600-4bea-98eb-e6748c99ba11', None, None, None, None, None)] {{(pid=109169) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 18:32:16.985267 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9000c8b2-ef5a-474a-8a16-53ed02a4cdac tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.336736 Oct 12 18:32:16.985975 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 400/813] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Oct 12 18:32:15 2021] POST /compute/v2.1/servers => generated 406 bytes in 1339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 18:32:16.990677 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-df2180c6-1a09-4a2b-8ff6-8cc76a33ce33 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:16.991391 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-df2180c6-1a09-4a2b-8ff6-8cc76a33ce33 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:17.005280 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-df2180c6-1a09-4a2b-8ff6-8cc76a33ce33 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:17.005816 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-df2180c6-1a09-4a2b-8ff6-8cc76a33ce33 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:17.006680 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-df2180c6-1a09-4a2b-8ff6-8cc76a33ce33 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:17.007394 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-df2180c6-1a09-4a2b-8ff6-8cc76a33ce33 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:17.033491 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-bea14af5-58b3-44cf-90b5-66aac7fbf7b4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Flavor limits 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 18:32:17.033491 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-bea14af5-58b3-44cf-90b5-66aac7fbf7b4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Image limits 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 18:32:17.033491 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-bea14af5-58b3-44cf-90b5-66aac7fbf7b4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Flavor pref 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 18:32:17.033491 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-bea14af5-58b3-44cf-90b5-66aac7fbf7b4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Image pref 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 18:32:17.033491 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-bea14af5-58b3-44cf-90b5-66aac7fbf7b4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 18:32:17.038306 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bea14af5-58b3-44cf-90b5-66aac7fbf7b4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:17.039013 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bea14af5-58b3-44cf-90b5-66aac7fbf7b4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:17.040050 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bea14af5-58b3-44cf-90b5-66aac7fbf7b4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:17.040938 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bea14af5-58b3-44cf-90b5-66aac7fbf7b4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:17.061441 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.quota [None req-bea14af5-58b3-44cf-90b5-66aac7fbf7b4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Getting quotas for project ee04649277c84912b20967b31162615b. Resources: {'instances', 'cores', 'ram'} {{(pid=109169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:32:17.065851 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.quota [None req-bea14af5-58b3-44cf-90b5-66aac7fbf7b4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Getting quotas for user 835bbb43ae5f48bfa14b22cb0a47cb4e and project ee04649277c84912b20967b31162615b. Resources: {'instances', 'cores', 'ram'} {{(pid=109169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:32:17.079797 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-bea14af5-58b3-44cf-90b5-66aac7fbf7b4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Going to run 1 instances... {{(pid=109169) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 18:32:17.082238 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-bea14af5-58b3-44cf-90b5-66aac7fbf7b4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c79f0511-74c5-46f3-a7e6-cde6b09234ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109169) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 18:32:17.154547 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-df2180c6-1a09-4a2b-8ff6-8cc76a33ce33 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:17.162303 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-df2180c6-1a09-4a2b-8ff6-8cc76a33ce33 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1569 microversion: 2.1 time: 0.175035 Oct 12 18:32:17.163118 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 401/814] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:16 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:17.167841 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d8313d7e-dea7-4828-bb79-acedf5758b1f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:17.168588 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d8313d7e-dea7-4828-bb79-acedf5758b1f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 527d2718-c3be-44f9-bf49-9c445e98cc75] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:17.226083 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d8313d7e-dea7-4828-bb79-acedf5758b1f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:17.233410 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d8313d7e-dea7-4828-bb79-acedf5758b1f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75" status: 200 len: 1094 microversion: 2.1 time: 0.069100 Oct 12 18:32:17.233975 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 402/815] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:17 2021] GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:17.275701 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-bea14af5-58b3-44cf-90b5-66aac7fbf7b4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.762672 Oct 12 18:32:17.276337 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 414/816] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Oct 12 18:32:16 2021] POST /compute/v2.1/servers => generated 402 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 18:32:17.287673 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-77946c4e-85e1-4f4f-8c1a-8fa9fef6d151 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:17.288290 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-77946c4e-85e1-4f4f-8c1a-8fa9fef6d151 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:17.356127 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-77946c4e-85e1-4f4f-8c1a-8fa9fef6d151 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:17.365790 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-77946c4e-85e1-4f4f-8c1a-8fa9fef6d151 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78" status: 200 len: 1237 microversion: 2.1 time: 0.080663 Oct 12 18:32:17.365790 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 403/817] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:17 2021] GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78 => generated 1237 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:17.531890 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-6c364b7b-d85e-4740-8df6-e02b7defaddf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:17.532626 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-6c364b7b-d85e-4740-8df6-e02b7defaddf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:17.539176 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6c364b7b-d85e-4740-8df6-e02b7defaddf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:17.539616 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6c364b7b-d85e-4740-8df6-e02b7defaddf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:17.540393 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6c364b7b-d85e-4740-8df6-e02b7defaddf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:17.540926 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6c364b7b-d85e-4740-8df6-e02b7defaddf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:17.743581 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-6c364b7b-d85e-4740-8df6-e02b7defaddf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:17.756855 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-6c364b7b-d85e-4740-8df6-e02b7defaddf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:17.758391 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-6c364b7b-d85e-4740-8df6-e02b7defaddf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:17.759698 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-6c364b7b-d85e-4740-8df6-e02b7defaddf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1407 microversion: 2.20 time: 0.232719 Oct 12 18:32:17.760424 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 415/818] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:32:17 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:32:17.828731 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-be9f28a5-7f3d-41a4-bf97-3161561b2fcb req-f3d55ceb-880c-45c1-a4d3-71d2c1b902ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a73458df-c845-4c48-9839-58d3acdfd4da", "name": "network-vif-plugged", "status": "completed", "tag": "6b4b7683-8980-4bd3-9e9f-66f9276cb054"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:17.830324 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:32:17.830324 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:32:17.843319 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-be9f28a5-7f3d-41a4-bf97-3161561b2fcb req-f3d55ceb-880c-45c1-a4d3-71d2c1b902ea service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:17.843769 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-be9f28a5-7f3d-41a4-bf97-3161561b2fcb req-f3d55ceb-880c-45c1-a4d3-71d2c1b902ea service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:17.855440 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-be9f28a5-7f3d-41a4-bf97-3161561b2fcb req-f3d55ceb-880c-45c1-a4d3-71d2c1b902ea service nova] Creating event network-vif-plugged:6b4b7683-8980-4bd3-9e9f-66f9276cb054 for instance a73458df-c845-4c48-9839-58d3acdfd4da on hv-cinder-81322 Oct 12 18:32:17.860386 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-be9f28a5-7f3d-41a4-bf97-3161561b2fcb req-f3d55ceb-880c-45c1-a4d3-71d2c1b902ea service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178960 Oct 12 18:32:17.864012 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 404/819] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:32:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 18:32:18.183834 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-0faf271d-3692-4ed2-94db-622d9b3c787d tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:18.184528 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-0faf271d-3692-4ed2-94db-622d9b3c787d tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:18.191309 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0faf271d-3692-4ed2-94db-622d9b3c787d tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:18.191757 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0faf271d-3692-4ed2-94db-622d9b3c787d tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:18.192655 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0faf271d-3692-4ed2-94db-622d9b3c787d tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:18.193088 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0faf271d-3692-4ed2-94db-622d9b3c787d tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:18.252840 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d73c3ad1-43ee-420d-b92f-f57953a51f17 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:18.253643 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d73c3ad1-43ee-420d-b92f-f57953a51f17 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 527d2718-c3be-44f9-bf49-9c445e98cc75] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:18.260582 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d73c3ad1-43ee-420d-b92f-f57953a51f17 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:18.261109 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d73c3ad1-43ee-420d-b92f-f57953a51f17 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:18.262009 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d73c3ad1-43ee-420d-b92f-f57953a51f17 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:18.262525 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d73c3ad1-43ee-420d-b92f-f57953a51f17 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:18.345583 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d73c3ad1-43ee-420d-b92f-f57953a51f17 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:18.354662 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d73c3ad1-43ee-420d-b92f-f57953a51f17 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75" status: 200 len: 1144 microversion: 2.1 time: 0.105840 Oct 12 18:32:18.355233 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 405/820] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:18 2021] GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75 => generated 1144 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:32:18.359231 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-0faf271d-3692-4ed2-94db-622d9b3c787d tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:18.368036 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-0faf271d-3692-4ed2-94db-622d9b3c787d tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1569 microversion: 2.1 time: 0.188605 Oct 12 18:32:18.368711 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 416/821] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:18 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:18.382844 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7204c782-0c6d-4836-9142-1976cd929583 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:18.383485 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7204c782-0c6d-4836-9142-1976cd929583 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:18.390243 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7204c782-0c6d-4836-9142-1976cd929583 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:18.390711 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7204c782-0c6d-4836-9142-1976cd929583 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:18.391613 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7204c782-0c6d-4836-9142-1976cd929583 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:18.392040 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7204c782-0c6d-4836-9142-1976cd929583 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:18.462668 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7204c782-0c6d-4836-9142-1976cd929583 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:18.469568 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7204c782-0c6d-4836-9142-1976cd929583 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78" status: 200 len: 1241 microversion: 2.1 time: 0.090456 Oct 12 18:32:18.470148 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 406/822] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:18 2021] GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78 => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:18.778751 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-a46e22f5-4c95-4819-b486-33b9d4641afd tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:18.779344 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-a46e22f5-4c95-4819-b486-33b9d4641afd tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:18.785678 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a46e22f5-4c95-4819-b486-33b9d4641afd tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:18.788762 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a46e22f5-4c95-4819-b486-33b9d4641afd tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:18.788762 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a46e22f5-4c95-4819-b486-33b9d4641afd tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:18.788762 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a46e22f5-4c95-4819-b486-33b9d4641afd tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:18.931237 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-a46e22f5-4c95-4819-b486-33b9d4641afd tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:18.939983 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-a46e22f5-4c95-4819-b486-33b9d4641afd tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:18.941608 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-a46e22f5-4c95-4819-b486-33b9d4641afd tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:18.942777 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-a46e22f5-4c95-4819-b486-33b9d4641afd tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1407 microversion: 2.20 time: 0.168262 Oct 12 18:32:18.943442 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 417/823] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:32:18 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:32:19.376650 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-854defe1-6b92-4c78-acca-b844df1050e4 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:19.377300 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-854defe1-6b92-4c78-acca-b844df1050e4 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 527d2718-c3be-44f9-bf49-9c445e98cc75] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:19.383188 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-854defe1-6b92-4c78-acca-b844df1050e4 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:19.383636 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-854defe1-6b92-4c78-acca-b844df1050e4 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:19.384420 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-854defe1-6b92-4c78-acca-b844df1050e4 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:19.384917 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-854defe1-6b92-4c78-acca-b844df1050e4 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:19.385141 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c84aaecf-a39d-4dc7-b1fe-d95983918c29 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:19.385978 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c84aaecf-a39d-4dc7-b1fe-d95983918c29 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:19.392503 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c84aaecf-a39d-4dc7-b1fe-d95983918c29 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:19.392949 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c84aaecf-a39d-4dc7-b1fe-d95983918c29 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:19.395033 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c84aaecf-a39d-4dc7-b1fe-d95983918c29 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:19.395639 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c84aaecf-a39d-4dc7-b1fe-d95983918c29 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:19.508113 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-854defe1-6b92-4c78-acca-b844df1050e4 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:19.515846 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-854defe1-6b92-4c78-acca-b844df1050e4 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75" status: 200 len: 1200 microversion: 2.1 time: 0.147274 Oct 12 18:32:19.516641 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 407/824] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:19 2021] GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75 => generated 1200 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:19.520790 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-92158a6a-b41a-4baf-a126-76f94ba0a6fa tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:19.521418 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-92158a6a-b41a-4baf-a126-76f94ba0a6fa tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:19.531293 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-92158a6a-b41a-4baf-a126-76f94ba0a6fa tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:19.531738 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-92158a6a-b41a-4baf-a126-76f94ba0a6fa tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:19.532587 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-92158a6a-b41a-4baf-a126-76f94ba0a6fa tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:19.533154 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-92158a6a-b41a-4baf-a126-76f94ba0a6fa tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:19.613108 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-92158a6a-b41a-4baf-a126-76f94ba0a6fa tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:19.631078 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-92158a6a-b41a-4baf-a126-76f94ba0a6fa tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78" status: 200 len: 1289 microversion: 2.1 time: 0.113169 Oct 12 18:32:19.631574 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 408/825] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:19 2021] GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78 => generated 1289 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:19.641897 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c84aaecf-a39d-4dc7-b1fe-d95983918c29 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:19.661295 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c84aaecf-a39d-4dc7-b1fe-d95983918c29 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1569 microversion: 2.1 time: 0.279248 Oct 12 18:32:19.661972 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 418/826] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:19 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1569 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:19.961600 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0efef998-2226-463a-9801-ca82ef3953f6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:19.962133 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0efef998-2226-463a-9801-ca82ef3953f6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:19.969009 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0efef998-2226-463a-9801-ca82ef3953f6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:19.969459 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0efef998-2226-463a-9801-ca82ef3953f6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:19.970275 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0efef998-2226-463a-9801-ca82ef3953f6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:19.970711 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0efef998-2226-463a-9801-ca82ef3953f6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:20.201592 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0efef998-2226-463a-9801-ca82ef3953f6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:20.217760 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0efef998-2226-463a-9801-ca82ef3953f6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:20.219466 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0efef998-2226-463a-9801-ca82ef3953f6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:20.220675 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0efef998-2226-463a-9801-ca82ef3953f6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1599 microversion: 2.20 time: 0.263267 Oct 12 18:32:20.221242 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 409/827] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:32:19 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1599 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:32:20.239192 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-45f50e9e-fd3d-4e46-a1c4-fcb44ce32b8f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:20.239748 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-45f50e9e-fd3d-4e46-a1c4-fcb44ce32b8f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:20.245852 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-45f50e9e-fd3d-4e46-a1c4-fcb44ce32b8f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:20.246291 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-45f50e9e-fd3d-4e46-a1c4-fcb44ce32b8f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:20.247119 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-45f50e9e-fd3d-4e46-a1c4-fcb44ce32b8f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:20.247693 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-45f50e9e-fd3d-4e46-a1c4-fcb44ce32b8f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:20.406397 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-45f50e9e-fd3d-4e46-a1c4-fcb44ce32b8f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.170942 Oct 12 18:32:20.406997 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 419/828] 10.222.0.18 () {60 vars in 1315 bytes} [Tue Oct 12 18:32:20 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/os-interface => generated 284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:32:20.534773 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-abbd2639-ac69-42ce-b8f0-5286b604e2de tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:20.536068 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-abbd2639-ac69-42ce-b8f0-5286b604e2de tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 527d2718-c3be-44f9-bf49-9c445e98cc75] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:20.548849 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-abbd2639-ac69-42ce-b8f0-5286b604e2de tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:20.551061 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-abbd2639-ac69-42ce-b8f0-5286b604e2de tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:20.554732 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-abbd2639-ac69-42ce-b8f0-5286b604e2de tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:20.555941 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-abbd2639-ac69-42ce-b8f0-5286b604e2de tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:20.660884 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-44d39703-6057-4925-8dc2-6af0f1d1fb65 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:20.661856 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-44d39703-6057-4925-8dc2-6af0f1d1fb65 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:20.683814 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-44d39703-6057-4925-8dc2-6af0f1d1fb65 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:20.684986 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-44d39703-6057-4925-8dc2-6af0f1d1fb65 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:20.690288 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-44d39703-6057-4925-8dc2-6af0f1d1fb65 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:20.693501 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-44d39703-6057-4925-8dc2-6af0f1d1fb65 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:20.888049 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-44d39703-6057-4925-8dc2-6af0f1d1fb65 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:20.899256 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-44d39703-6057-4925-8dc2-6af0f1d1fb65 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78" status: 200 len: 1307 microversion: 2.1 time: 0.242806 Oct 12 18:32:20.899851 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 420/829] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:20 2021] GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78 => generated 1307 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:20.904781 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-10bd0fb9-ecc5-411b-8deb-9035ba122903 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:20.905387 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-10bd0fb9-ecc5-411b-8deb-9035ba122903 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:20.921448 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-10bd0fb9-ecc5-411b-8deb-9035ba122903 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:20.921895 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-10bd0fb9-ecc5-411b-8deb-9035ba122903 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:20.922709 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-10bd0fb9-ecc5-411b-8deb-9035ba122903 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:20.923156 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-10bd0fb9-ecc5-411b-8deb-9035ba122903 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:20.952885 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-abbd2639-ac69-42ce-b8f0-5286b604e2de tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:20.963718 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-abbd2639-ac69-42ce-b8f0-5286b604e2de tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75" status: 200 len: 1278 microversion: 2.1 time: 0.433738 Oct 12 18:32:20.965281 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 410/830] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:20 2021] GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75 => generated 1278 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:21.237237 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-10bd0fb9-ecc5-411b-8deb-9035ba122903 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:21.245723 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-10bd0fb9-ecc5-411b-8deb-9035ba122903 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1569 microversion: 2.1 time: 0.344594 Oct 12 18:32:21.246414 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 421/831] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:20 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1569 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:21.910225 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-52e2d139-b519-4ba4-b835-dc37312290ea tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:21.917828 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-52e2d139-b519-4ba4-b835-dc37312290ea tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:21.935851 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-52e2d139-b519-4ba4-b835-dc37312290ea tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:21.936611 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-52e2d139-b519-4ba4-b835-dc37312290ea tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:21.937398 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-52e2d139-b519-4ba4-b835-dc37312290ea tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:21.937831 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-52e2d139-b519-4ba4-b835-dc37312290ea tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:22.011255 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-52e2d139-b519-4ba4-b835-dc37312290ea tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 14 microversion: 2.20 time: 0.104697 Oct 12 18:32:22.011876 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 411/832] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:21 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:22.014561 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-c81680bf-08a6-4ef8-9541-45a777f55ea6 req-dec5c90f-6453-4200-bc2f-905d982be0f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a73458df-c845-4c48-9839-58d3acdfd4da", "tag": "6b4b7683-8980-4bd3-9e9f-66f9276cb054"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:22.016228 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:32:22.016228 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:32:22.018988 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1af4e4f1-c872-4cea-a287-11bec750de13 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:22.019697 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1af4e4f1-c872-4cea-a287-11bec750de13 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:22.023891 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-c81680bf-08a6-4ef8-9541-45a777f55ea6 req-dec5c90f-6453-4200-bc2f-905d982be0f0 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:22.024326 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-c81680bf-08a6-4ef8-9541-45a777f55ea6 req-dec5c90f-6453-4200-bc2f-905d982be0f0 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:22.027199 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1af4e4f1-c872-4cea-a287-11bec750de13 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:22.027647 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1af4e4f1-c872-4cea-a287-11bec750de13 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:22.029690 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1af4e4f1-c872-4cea-a287-11bec750de13 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:22.029690 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1af4e4f1-c872-4cea-a287-11bec750de13 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:22.037471 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-c81680bf-08a6-4ef8-9541-45a777f55ea6 req-dec5c90f-6453-4200-bc2f-905d982be0f0 service nova] Creating event network-changed:6b4b7683-8980-4bd3-9e9f-66f9276cb054 for instance a73458df-c845-4c48-9839-58d3acdfd4da on hv-cinder-81322 Oct 12 18:32:22.043013 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-c81680bf-08a6-4ef8-9541-45a777f55ea6 req-dec5c90f-6453-4200-bc2f-905d982be0f0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130168 Oct 12 18:32:22.043698 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 422/833] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:32:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:32:22.049728 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-92b763c7-1f1c-4e75-96de-ea92e291a4a7 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:22.050505 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-92b763c7-1f1c-4e75-96de-ea92e291a4a7 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 527d2718-c3be-44f9-bf49-9c445e98cc75] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:22.067543 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-92b763c7-1f1c-4e75-96de-ea92e291a4a7 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:22.068369 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-92b763c7-1f1c-4e75-96de-ea92e291a4a7 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:22.069524 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-92b763c7-1f1c-4e75-96de-ea92e291a4a7 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:22.070214 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-92b763c7-1f1c-4e75-96de-ea92e291a4a7 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:22.544954 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1af4e4f1-c872-4cea-a287-11bec750de13 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:22.553001 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1af4e4f1-c872-4cea-a287-11bec750de13 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78" status: 200 len: 1363 microversion: 2.1 time: 0.539732 Oct 12 18:32:22.557579 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 412/834] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:22 2021] GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78 => generated 1363 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:22.564479 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-64eb901b-dd20-4ecd-b04d-8586f9bdd0c9 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:22.568854 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-64eb901b-dd20-4ecd-b04d-8586f9bdd0c9 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:22.589418 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-64eb901b-dd20-4ecd-b04d-8586f9bdd0c9 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:22.589418 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-64eb901b-dd20-4ecd-b04d-8586f9bdd0c9 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:22.589418 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-64eb901b-dd20-4ecd-b04d-8586f9bdd0c9 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:22.589418 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-64eb901b-dd20-4ecd-b04d-8586f9bdd0c9 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:22.599519 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-92b763c7-1f1c-4e75-96de-ea92e291a4a7 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:22.624916 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-92b763c7-1f1c-4e75-96de-ea92e291a4a7 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75" status: 200 len: 1266 microversion: 2.1 time: 0.579660 Oct 12 18:32:22.639247 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 423/835] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:22 2021] GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75 => generated 1266 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:22.958955 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-64eb901b-dd20-4ecd-b04d-8586f9bdd0c9 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:22.966367 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-64eb901b-dd20-4ecd-b04d-8586f9bdd0c9 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1569 microversion: 2.1 time: 0.407160 Oct 12 18:32:22.966944 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 413/836] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:22 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1569 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:23.022497 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-99dfffd9-5b12-4cb6-bd34-db83de16f818 req-215eef8c-9484-4689-8394-fd5a3470274a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "527d2718-c3be-44f9-bf49-9c445e98cc75", "tag": "260f73ad-348d-4e3f-8940-94a948e1eaae"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:23.024694 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:32:23.024694 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:32:23.032790 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f6b0bf11-18e7-4a9e-a492-8776b0f4a03b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:23.036698 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f6b0bf11-18e7-4a9e-a492-8776b0f4a03b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:23.039578 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-99dfffd9-5b12-4cb6-bd34-db83de16f818 req-215eef8c-9484-4689-8394-fd5a3470274a service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:23.040288 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-99dfffd9-5b12-4cb6-bd34-db83de16f818 req-215eef8c-9484-4689-8394-fd5a3470274a service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:23.060748 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f6b0bf11-18e7-4a9e-a492-8776b0f4a03b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:23.061196 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f6b0bf11-18e7-4a9e-a492-8776b0f4a03b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:23.061993 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f6b0bf11-18e7-4a9e-a492-8776b0f4a03b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:23.062422 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f6b0bf11-18e7-4a9e-a492-8776b0f4a03b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:23.071671 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-99dfffd9-5b12-4cb6-bd34-db83de16f818 req-215eef8c-9484-4689-8394-fd5a3470274a service nova] Creating event network-changed:260f73ad-348d-4e3f-8940-94a948e1eaae for instance 527d2718-c3be-44f9-bf49-9c445e98cc75 on hv-cinder-81322 Oct 12 18:32:23.080378 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-99dfffd9-5b12-4cb6-bd34-db83de16f818 req-215eef8c-9484-4689-8394-fd5a3470274a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064197 Oct 12 18:32:23.083075 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 424/837] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:32:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:32:23.149985 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f6b0bf11-18e7-4a9e-a492-8776b0f4a03b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 14 microversion: 2.20 time: 0.131438 Oct 12 18:32:23.150816 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 414/838] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:23 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:23.575199 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-d1a8a3fb-b722-484e-875a-231b6c9ee5bf tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:23.576452 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-d1a8a3fb-b722-484e-875a-231b6c9ee5bf tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:23.584902 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d1a8a3fb-b722-484e-875a-231b6c9ee5bf tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:23.585355 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d1a8a3fb-b722-484e-875a-231b6c9ee5bf tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:23.586138 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d1a8a3fb-b722-484e-875a-231b6c9ee5bf tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:23.586572 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d1a8a3fb-b722-484e-875a-231b6c9ee5bf tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:23.648156 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-6cbe65ca-6d77-4a79-9217-0835583c4de4 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:23.649229 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-6cbe65ca-6d77-4a79-9217-0835583c4de4 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 527d2718-c3be-44f9-bf49-9c445e98cc75] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:23.658448 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6cbe65ca-6d77-4a79-9217-0835583c4de4 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:23.659038 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6cbe65ca-6d77-4a79-9217-0835583c4de4 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:23.659981 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6cbe65ca-6d77-4a79-9217-0835583c4de4 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:23.660583 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6cbe65ca-6d77-4a79-9217-0835583c4de4 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:24.035039 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-d1a8a3fb-b722-484e-875a-231b6c9ee5bf tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:24.042738 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-d1a8a3fb-b722-484e-875a-231b6c9ee5bf tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78" status: 200 len: 1363 microversion: 2.1 time: 0.472158 Oct 12 18:32:24.043645 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 425/839] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:23 2021] GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78 => generated 1363 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:24.051848 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-6cbe65ca-6d77-4a79-9217-0835583c4de4 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:24.066653 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-1f4efbfb-c32b-4ac6-a3ae-18f4f921dc87 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:24.069845 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-1f4efbfb-c32b-4ac6-a3ae-18f4f921dc87 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:24.074320 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-6cbe65ca-6d77-4a79-9217-0835583c4de4 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75" status: 200 len: 1266 microversion: 2.1 time: 0.430839 Oct 12 18:32:24.075099 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 415/840] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:23 2021] GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75 => generated 1266 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:24.076843 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1f4efbfb-c32b-4ac6-a3ae-18f4f921dc87 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:24.077294 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1f4efbfb-c32b-4ac6-a3ae-18f4f921dc87 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:24.078080 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1f4efbfb-c32b-4ac6-a3ae-18f4f921dc87 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:24.078508 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1f4efbfb-c32b-4ac6-a3ae-18f4f921dc87 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:24.162340 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ff7e98ba-d66a-4a9d-b216-4da01614c594 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:24.163294 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ff7e98ba-d66a-4a9d-b216-4da01614c594 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:24.169984 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ff7e98ba-d66a-4a9d-b216-4da01614c594 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:24.170428 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ff7e98ba-d66a-4a9d-b216-4da01614c594 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:24.171215 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ff7e98ba-d66a-4a9d-b216-4da01614c594 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:24.171648 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ff7e98ba-d66a-4a9d-b216-4da01614c594 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:24.229640 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ff7e98ba-d66a-4a9d-b216-4da01614c594 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 14 microversion: 2.20 time: 0.071032 Oct 12 18:32:24.232795 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 416/841] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:24 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:32:24.357178 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-1f4efbfb-c32b-4ac6-a3ae-18f4f921dc87 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:24.364670 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-1f4efbfb-c32b-4ac6-a3ae-18f4f921dc87 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1569 microversion: 2.1 time: 0.319769 Oct 12 18:32:24.365253 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 426/842] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:24 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1569 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:25.066168 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ce4c339d-2f83-416e-b07c-65aa06cacc2c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:25.066919 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ce4c339d-2f83-416e-b07c-65aa06cacc2c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:25.074017 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ce4c339d-2f83-416e-b07c-65aa06cacc2c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:25.074832 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ce4c339d-2f83-416e-b07c-65aa06cacc2c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:25.075222 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ce4c339d-2f83-416e-b07c-65aa06cacc2c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:25.075647 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ce4c339d-2f83-416e-b07c-65aa06cacc2c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:25.091179 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-e3266683-1932-4a31-8312-ce4a990006a1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:25.091881 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-e3266683-1932-4a31-8312-ce4a990006a1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 527d2718-c3be-44f9-bf49-9c445e98cc75] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:25.098420 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e3266683-1932-4a31-8312-ce4a990006a1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:25.098871 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e3266683-1932-4a31-8312-ce4a990006a1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:25.099644 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e3266683-1932-4a31-8312-ce4a990006a1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:25.100074 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e3266683-1932-4a31-8312-ce4a990006a1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:25.260694 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ce4c339d-2f83-416e-b07c-65aa06cacc2c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:25.269612 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ce4c339d-2f83-416e-b07c-65aa06cacc2c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78" status: 200 len: 1363 microversion: 2.1 time: 0.207394 Oct 12 18:32:25.270195 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 417/843] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:25 2021] GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78 => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:32:25.275192 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-a745ea6b-6278-459f-a394-cf98729a5e76 req-1e78ff73-c609-4e9d-9897-0f197bd5a236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4adfbcc5-a227-49b4-aea6-24a58adcbd78", "tag": "5768eef0-c768-4c9b-af39-569bde13629c"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:25.278665 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:32:25.278665 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:32:25.283865 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-e3266683-1932-4a31-8312-ce4a990006a1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:25.289791 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-a745ea6b-6278-459f-a394-cf98729a5e76 req-1e78ff73-c609-4e9d-9897-0f197bd5a236 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:25.290238 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-a745ea6b-6278-459f-a394-cf98729a5e76 req-1e78ff73-c609-4e9d-9897-0f197bd5a236 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:25.291582 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-e3266683-1932-4a31-8312-ce4a990006a1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75" status: 200 len: 1266 microversion: 2.1 time: 0.204781 Oct 12 18:32:25.292242 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 427/844] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:25 2021] GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:32:25.296877 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-bf90d53b-2871-4760-8e6c-e8eebc33f9d5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:25.297926 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-bf90d53b-2871-4760-8e6c-e8eebc33f9d5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:25.302995 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-a745ea6b-6278-459f-a394-cf98729a5e76 req-1e78ff73-c609-4e9d-9897-0f197bd5a236 service nova] Creating event network-changed:5768eef0-c768-4c9b-af39-569bde13629c for instance 4adfbcc5-a227-49b4-aea6-24a58adcbd78 on hv-cinder-81322 Oct 12 18:32:25.303908 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bf90d53b-2871-4760-8e6c-e8eebc33f9d5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:25.304357 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bf90d53b-2871-4760-8e6c-e8eebc33f9d5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:25.305153 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bf90d53b-2871-4760-8e6c-e8eebc33f9d5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:25.305578 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bf90d53b-2871-4760-8e6c-e8eebc33f9d5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:25.308650 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-a745ea6b-6278-459f-a394-cf98729a5e76 req-1e78ff73-c609-4e9d-9897-0f197bd5a236 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037329 Oct 12 18:32:25.309654 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 418/845] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:32:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:32:25.380203 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-bf90d53b-2871-4760-8e6c-e8eebc33f9d5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 14 microversion: 2.20 time: 0.086428 Oct 12 18:32:25.382631 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5bc5f7dd-7151-4ec9-96e9-575672f10dcb tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:25.383322 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5bc5f7dd-7151-4ec9-96e9-575672f10dcb tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:25.385240 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 428/846] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:25 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:25.391432 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5bc5f7dd-7151-4ec9-96e9-575672f10dcb tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:25.391877 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5bc5f7dd-7151-4ec9-96e9-575672f10dcb tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:25.392874 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5bc5f7dd-7151-4ec9-96e9-575672f10dcb tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:25.393420 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5bc5f7dd-7151-4ec9-96e9-575672f10dcb tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:25.612243 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5bc5f7dd-7151-4ec9-96e9-575672f10dcb tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:25.621267 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5bc5f7dd-7151-4ec9-96e9-575672f10dcb tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1569 microversion: 2.1 time: 0.243008 Oct 12 18:32:25.621962 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 419/847] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:25 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1569 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:32:26.287142 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c065b3e6-dc83-4d99-bc13-c92a8f215f97 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:26.287926 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c065b3e6-dc83-4d99-bc13-c92a8f215f97 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:26.294584 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c065b3e6-dc83-4d99-bc13-c92a8f215f97 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:26.295024 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c065b3e6-dc83-4d99-bc13-c92a8f215f97 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:26.295792 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c065b3e6-dc83-4d99-bc13-c92a8f215f97 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:26.296263 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c065b3e6-dc83-4d99-bc13-c92a8f215f97 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:26.308711 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a2898455-d29e-4a9b-b7ba-5162442ed895 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:26.309320 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a2898455-d29e-4a9b-b7ba-5162442ed895 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 527d2718-c3be-44f9-bf49-9c445e98cc75] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:26.327664 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a2898455-d29e-4a9b-b7ba-5162442ed895 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:26.328428 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a2898455-d29e-4a9b-b7ba-5162442ed895 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:26.330144 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a2898455-d29e-4a9b-b7ba-5162442ed895 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:26.330759 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a2898455-d29e-4a9b-b7ba-5162442ed895 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:26.605865 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c065b3e6-dc83-4d99-bc13-c92a8f215f97 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:26.616852 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c065b3e6-dc83-4d99-bc13-c92a8f215f97 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78" status: 200 len: 1363 microversion: 2.1 time: 0.331104 Oct 12 18:32:26.618396 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 429/848] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:26 2021] GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78 => generated 1363 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:26.620132 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a2898455-d29e-4a9b-b7ba-5162442ed895 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:26.623421 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-63d112ac-fa7f-413e-be44-a69e746e23d0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:26.624383 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-63d112ac-fa7f-413e-be44-a69e746e23d0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:26.628956 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a2898455-d29e-4a9b-b7ba-5162442ed895 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75" status: 200 len: 1266 microversion: 2.1 time: 0.323712 Oct 12 18:32:26.629864 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 420/849] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:26 2021] GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75 => generated 1266 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:26.633880 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-63d112ac-fa7f-413e-be44-a69e746e23d0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:26.636055 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-63d112ac-fa7f-413e-be44-a69e746e23d0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:26.637264 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-63d112ac-fa7f-413e-be44-a69e746e23d0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:26.638731 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-63d112ac-fa7f-413e-be44-a69e746e23d0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:26.649013 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ff565b42-d31d-47df-989f-2340d6dc017d tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:26.650103 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ff565b42-d31d-47df-989f-2340d6dc017d tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:26.656564 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ff565b42-d31d-47df-989f-2340d6dc017d tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:26.657332 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ff565b42-d31d-47df-989f-2340d6dc017d tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:26.658280 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ff565b42-d31d-47df-989f-2340d6dc017d tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:26.658921 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ff565b42-d31d-47df-989f-2340d6dc017d tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:26.703054 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-63d112ac-fa7f-413e-be44-a69e746e23d0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 14 microversion: 2.20 time: 0.083745 Oct 12 18:32:26.703867 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 430/850] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:26 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:26.847736 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ff565b42-d31d-47df-989f-2340d6dc017d tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:26.855588 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ff565b42-d31d-47df-989f-2340d6dc017d tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1569 microversion: 2.1 time: 0.210070 Oct 12 18:32:26.856170 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 421/851] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:26 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1569 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:27.637766 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c34d60bb-e6ab-437b-a301-868217e61dcc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:27.640353 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c34d60bb-e6ab-437b-a301-868217e61dcc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:27.646267 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c34d60bb-e6ab-437b-a301-868217e61dcc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:27.646724 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c34d60bb-e6ab-437b-a301-868217e61dcc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:27.647501 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c34d60bb-e6ab-437b-a301-868217e61dcc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:27.647928 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c34d60bb-e6ab-437b-a301-868217e61dcc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:27.648043 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-dd64271f-4afd-424e-94ed-15a8319267ae tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:27.648604 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-dd64271f-4afd-424e-94ed-15a8319267ae tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 527d2718-c3be-44f9-bf49-9c445e98cc75] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:27.655075 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dd64271f-4afd-424e-94ed-15a8319267ae tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:27.655515 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dd64271f-4afd-424e-94ed-15a8319267ae tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:27.656288 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dd64271f-4afd-424e-94ed-15a8319267ae tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:27.656799 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dd64271f-4afd-424e-94ed-15a8319267ae tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:27.828605 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-dd64271f-4afd-424e-94ed-15a8319267ae tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:27.835783 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c34d60bb-e6ab-437b-a301-868217e61dcc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:27.836095 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-dd64271f-4afd-424e-94ed-15a8319267ae tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75" status: 200 len: 1266 microversion: 2.1 time: 0.191669 Oct 12 18:32:27.836712 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 422/852] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:27 2021] GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:32:27.841370 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-553f59b3-3c85-4427-a29a-2daabe788a57 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:27.842352 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-553f59b3-3c85-4427-a29a-2daabe788a57 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:27.843028 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c34d60bb-e6ab-437b-a301-868217e61dcc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78" status: 200 len: 1363 microversion: 2.1 time: 0.213019 Oct 12 18:32:27.851935 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 431/853] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:27 2021] GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78 => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:27.852142 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-553f59b3-3c85-4427-a29a-2daabe788a57 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:27.852142 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-553f59b3-3c85-4427-a29a-2daabe788a57 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:27.852142 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-553f59b3-3c85-4427-a29a-2daabe788a57 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:27.852142 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-553f59b3-3c85-4427-a29a-2daabe788a57 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:27.873345 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-e9fd0882-2cc5-41e1-8dbe-183670d94cab tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:27.873956 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-e9fd0882-2cc5-41e1-8dbe-183670d94cab tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:27.879760 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e9fd0882-2cc5-41e1-8dbe-183670d94cab tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:27.880203 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e9fd0882-2cc5-41e1-8dbe-183670d94cab tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:27.881003 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e9fd0882-2cc5-41e1-8dbe-183670d94cab tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:27.881441 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e9fd0882-2cc5-41e1-8dbe-183670d94cab tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:27.920128 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-553f59b3-3c85-4427-a29a-2daabe788a57 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 14 microversion: 2.20 time: 0.082159 Oct 12 18:32:27.921050 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 423/854] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:27 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:28.010985 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-e9fd0882-2cc5-41e1-8dbe-183670d94cab tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:28.020602 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-e9fd0882-2cc5-41e1-8dbe-183670d94cab tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1569 microversion: 2.1 time: 0.151320 Oct 12 18:32:28.021495 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 432/855] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:27 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:32:28.853532 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c18cb2ba-d69b-415b-aefa-c3ca8269106b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:28.854340 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c18cb2ba-d69b-415b-aefa-c3ca8269106b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 527d2718-c3be-44f9-bf49-9c445e98cc75] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:28.858636 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-9b968c23-1b01-4693-ac92-3c3b79938e60 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:28.859240 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-9b968c23-1b01-4693-ac92-3c3b79938e60 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:28.860854 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c18cb2ba-d69b-415b-aefa-c3ca8269106b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:28.861581 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c18cb2ba-d69b-415b-aefa-c3ca8269106b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:28.862231 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c18cb2ba-d69b-415b-aefa-c3ca8269106b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:28.862507 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c18cb2ba-d69b-415b-aefa-c3ca8269106b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:28.865629 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9b968c23-1b01-4693-ac92-3c3b79938e60 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:28.866081 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9b968c23-1b01-4693-ac92-3c3b79938e60 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:28.866834 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9b968c23-1b01-4693-ac92-3c3b79938e60 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:28.867262 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9b968c23-1b01-4693-ac92-3c3b79938e60 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:29.051549 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c18cb2ba-d69b-415b-aefa-c3ca8269106b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:29.059188 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c18cb2ba-d69b-415b-aefa-c3ca8269106b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75" status: 200 len: 1266 microversion: 2.1 time: 0.209678 Oct 12 18:32:29.060499 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 424/856] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:28 2021] GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75 => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:29.060687 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-9b968c23-1b01-4693-ac92-3c3b79938e60 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:29.064289 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-02818710-b75d-4463-95bb-e07624d77b42 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:29.065211 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-02818710-b75d-4463-95bb-e07624d77b42 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:29.070099 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-9b968c23-1b01-4693-ac92-3c3b79938e60 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78" status: 200 len: 1363 microversion: 2.1 time: 0.214724 Oct 12 18:32:29.070835 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 433/857] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:28 2021] GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78 => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:29.070964 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-02818710-b75d-4463-95bb-e07624d77b42 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:29.071345 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-02818710-b75d-4463-95bb-e07624d77b42 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:29.072955 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-02818710-b75d-4463-95bb-e07624d77b42 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:29.073404 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-02818710-b75d-4463-95bb-e07624d77b42 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:29.076273 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-258387bb-04aa-45db-88ef-4cc0de8efd3f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:29.077093 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-258387bb-04aa-45db-88ef-4cc0de8efd3f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:29.083091 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-258387bb-04aa-45db-88ef-4cc0de8efd3f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:29.083729 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-258387bb-04aa-45db-88ef-4cc0de8efd3f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:29.084694 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-258387bb-04aa-45db-88ef-4cc0de8efd3f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:29.085396 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-258387bb-04aa-45db-88ef-4cc0de8efd3f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:29.131286 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-02818710-b75d-4463-95bb-e07624d77b42 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 14 microversion: 2.20 time: 0.070287 Oct 12 18:32:29.132272 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 425/858] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:29 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:29.223995 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-258387bb-04aa-45db-88ef-4cc0de8efd3f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:29.224161 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-258387bb-04aa-45db-88ef-4cc0de8efd3f tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1569 microversion: 2.1 time: 0.151982 Oct 12 18:32:29.224629 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 434/859] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:29 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:29.658353 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-d177b847-0d85-4335-bc03-275e19a0ac88 req-f4d346b9-53c9-412d-96a5-5b65ce472458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4adfbcc5-a227-49b4-aea6-24a58adcbd78", "name": "network-vif-plugged", "status": "completed", "tag": "5768eef0-c768-4c9b-af39-569bde13629c"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:29.659915 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:32:29.659915 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:32:29.668337 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-d177b847-0d85-4335-bc03-275e19a0ac88 req-f4d346b9-53c9-412d-96a5-5b65ce472458 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:29.668882 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-d177b847-0d85-4335-bc03-275e19a0ac88 req-f4d346b9-53c9-412d-96a5-5b65ce472458 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:29.679796 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-d177b847-0d85-4335-bc03-275e19a0ac88 req-f4d346b9-53c9-412d-96a5-5b65ce472458 service nova] Creating event network-vif-plugged:5768eef0-c768-4c9b-af39-569bde13629c for instance 4adfbcc5-a227-49b4-aea6-24a58adcbd78 on hv-cinder-81322 Oct 12 18:32:29.684639 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-d177b847-0d85-4335-bc03-275e19a0ac88 req-f4d346b9-53c9-412d-96a5-5b65ce472458 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030324 Oct 12 18:32:29.685275 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 426/860] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:32:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:32:30.075797 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-5bb89ed5-8bf8-497e-9dec-84ba1d3f3571 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:30.076430 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-5bb89ed5-8bf8-497e-9dec-84ba1d3f3571 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 527d2718-c3be-44f9-bf49-9c445e98cc75] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:30.082258 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5bb89ed5-8bf8-497e-9dec-84ba1d3f3571 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:30.082701 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5bb89ed5-8bf8-497e-9dec-84ba1d3f3571 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:30.083740 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5bb89ed5-8bf8-497e-9dec-84ba1d3f3571 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:30.084183 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5bb89ed5-8bf8-497e-9dec-84ba1d3f3571 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:30.090759 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e30745c5-8f61-41c5-94da-723a91c3fd5d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:30.096184 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e30745c5-8f61-41c5-94da-723a91c3fd5d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:30.102117 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e30745c5-8f61-41c5-94da-723a91c3fd5d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:30.102653 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e30745c5-8f61-41c5-94da-723a91c3fd5d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:30.105338 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e30745c5-8f61-41c5-94da-723a91c3fd5d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:30.106204 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e30745c5-8f61-41c5-94da-723a91c3fd5d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:30.349521 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-5bb89ed5-8bf8-497e-9dec-84ba1d3f3571 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:30.356359 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e30745c5-8f61-41c5-94da-723a91c3fd5d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:30.356899 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-5bb89ed5-8bf8-497e-9dec-84ba1d3f3571 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75" status: 200 len: 1266 microversion: 2.1 time: 0.284661 Oct 12 18:32:30.357477 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 435/861] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:30 2021] GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75 => generated 1266 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:30.361875 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-288275b2-057b-4f7e-a9c6-41747391743a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:30.363136 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-288275b2-057b-4f7e-a9c6-41747391743a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:30.364285 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e30745c5-8f61-41c5-94da-723a91c3fd5d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78" status: 200 len: 1363 microversion: 2.1 time: 0.279221 Oct 12 18:32:30.364880 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 427/862] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:30 2021] GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78 => generated 1363 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:30.369030 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-288275b2-057b-4f7e-a9c6-41747391743a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:30.370044 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-288275b2-057b-4f7e-a9c6-41747391743a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:30.370218 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f64d36f2-eca9-4c32-ab68-6cd1c62c6180 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:30.370808 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-288275b2-057b-4f7e-a9c6-41747391743a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:30.370938 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f64d36f2-eca9-4c32-ab68-6cd1c62c6180 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:30.371500 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-288275b2-057b-4f7e-a9c6-41747391743a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:30.377108 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f64d36f2-eca9-4c32-ab68-6cd1c62c6180 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:30.377548 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f64d36f2-eca9-4c32-ab68-6cd1c62c6180 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:30.378342 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f64d36f2-eca9-4c32-ab68-6cd1c62c6180 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:30.378749 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f64d36f2-eca9-4c32-ab68-6cd1c62c6180 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:30.509973 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f64d36f2-eca9-4c32-ab68-6cd1c62c6180 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:30.517598 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f64d36f2-eca9-4c32-ab68-6cd1c62c6180 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1510 microversion: 2.1 time: 0.151486 Oct 12 18:32:30.518177 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 428/863] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:30 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:30.534623 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-6dfc6b41-d962-424e-84fc-8adbd1ac26df tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:30.535194 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-6dfc6b41-d962-424e-84fc-8adbd1ac26df tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:30.542223 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6dfc6b41-d962-424e-84fc-8adbd1ac26df tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:30.542662 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6dfc6b41-d962-424e-84fc-8adbd1ac26df tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:30.543430 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6dfc6b41-d962-424e-84fc-8adbd1ac26df tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:30.543857 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6dfc6b41-d962-424e-84fc-8adbd1ac26df tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:30.657214 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-288275b2-057b-4f7e-a9c6-41747391743a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 14 microversion: 2.20 time: 0.298423 Oct 12 18:32:30.657870 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 436/864] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:30 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 14 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:30.786787 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-6dfc6b41-d962-424e-84fc-8adbd1ac26df tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "POST /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c/action" status: 202 len: 0 microversion: 2.1 time: 0.255741 Oct 12 18:32:30.787494 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 429/865] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:32:30 2021] POST /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:32:30.796486 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-ee7bc6fa-8804-4ac5-90e2-e0ea354e6b7b tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:30.798451 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-ee7bc6fa-8804-4ac5-90e2-e0ea354e6b7b tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:30.803532 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ee7bc6fa-8804-4ac5-90e2-e0ea354e6b7b tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:30.804104 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ee7bc6fa-8804-4ac5-90e2-e0ea354e6b7b tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:30.804970 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ee7bc6fa-8804-4ac5-90e2-e0ea354e6b7b tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:30.805399 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ee7bc6fa-8804-4ac5-90e2-e0ea354e6b7b tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:30.936412 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-ee7bc6fa-8804-4ac5-90e2-e0ea354e6b7b tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:30.944070 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-ee7bc6fa-8804-4ac5-90e2-e0ea354e6b7b tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1518 microversion: 2.1 time: 0.151691 Oct 12 18:32:30.944937 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 437/866] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:30 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:31.382873 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1d9017db-6d2e-42bd-a5cf-17a8e819a753 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:31.383465 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1d9017db-6d2e-42bd-a5cf-17a8e819a753 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:31.389756 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-11b4a1c6-8670-4cf9-8bd5-8f98bcc3fcc5 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:31.390311 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-11b4a1c6-8670-4cf9-8bd5-8f98bcc3fcc5 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 527d2718-c3be-44f9-bf49-9c445e98cc75] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:31.396260 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-11b4a1c6-8670-4cf9-8bd5-8f98bcc3fcc5 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:31.396741 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-11b4a1c6-8670-4cf9-8bd5-8f98bcc3fcc5 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:31.397439 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1d9017db-6d2e-42bd-a5cf-17a8e819a753 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:31.404928 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-11b4a1c6-8670-4cf9-8bd5-8f98bcc3fcc5 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:31.405072 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1d9017db-6d2e-42bd-a5cf-17a8e819a753 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:31.405182 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-11b4a1c6-8670-4cf9-8bd5-8f98bcc3fcc5 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:31.405287 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1d9017db-6d2e-42bd-a5cf-17a8e819a753 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:31.405287 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1d9017db-6d2e-42bd-a5cf-17a8e819a753 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:31.592544 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-11b4a1c6-8670-4cf9-8bd5-8f98bcc3fcc5 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:31.599884 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-11b4a1c6-8670-4cf9-8bd5-8f98bcc3fcc5 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75" status: 200 len: 1266 microversion: 2.1 time: 0.213649 Oct 12 18:32:31.600477 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 438/867] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:31 2021] GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:31.600620 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1d9017db-6d2e-42bd-a5cf-17a8e819a753 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:31.607973 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1d9017db-6d2e-42bd-a5cf-17a8e819a753 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78" status: 200 len: 1363 microversion: 2.1 time: 0.228759 Oct 12 18:32:31.608925 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 430/868] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:31 2021] GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:31.668382 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-db2ea065-a921-42ce-b13a-48a1afb5a9b0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:31.669319 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-db2ea065-a921-42ce-b13a-48a1afb5a9b0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:31.675252 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-db2ea065-a921-42ce-b13a-48a1afb5a9b0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:31.675700 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-db2ea065-a921-42ce-b13a-48a1afb5a9b0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:31.676620 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-db2ea065-a921-42ce-b13a-48a1afb5a9b0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:31.677062 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-db2ea065-a921-42ce-b13a-48a1afb5a9b0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:31.700152 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-4647f00a-ee1a-43b8-964f-79c7a460e4e4 req-a55429af-42db-47e3-9712-763cd2d121a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f0cf04d-323c-4749-b9ae-d35333eb565c", "name": "network-vif-unplugged", "status": "completed", "tag": "ee9e0115-2251-43e7-8da4-8dd846258e7b"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:31.701261 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:32:31.701261 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:32:31.708270 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-4647f00a-ee1a-43b8-964f-79c7a460e4e4 req-a55429af-42db-47e3-9712-763cd2d121a9 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:31.708752 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-4647f00a-ee1a-43b8-964f-79c7a460e4e4 req-a55429af-42db-47e3-9712-763cd2d121a9 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:31.719970 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.compute.server_external_events [req-4647f00a-ee1a-43b8-964f-79c7a460e4e4 req-a55429af-42db-47e3-9712-763cd2d121a9 service nova] Unable to find a host for instance 1f0cf04d-323c-4749-b9ae-d35333eb565c. Dropping event network-vif-unplugged {{(pid=109168) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Oct 12 18:32:31.720883 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-4647f00a-ee1a-43b8-964f-79c7a460e4e4 req-a55429af-42db-47e3-9712-763cd2d121a9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.024943 Oct 12 18:32:31.721637 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 431/869] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:32:31 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 12 18:32:31.912942 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-db2ea065-a921-42ce-b13a-48a1afb5a9b0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 14 microversion: 2.20 time: 0.248373 Oct 12 18:32:31.913547 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 439/870] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:31 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 14 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:31.962417 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-80158c7d-1c8e-4eb5-a545-16178a0a3362 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:31.963620 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-80158c7d-1c8e-4eb5-a545-16178a0a3362 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:31.970354 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-80158c7d-1c8e-4eb5-a545-16178a0a3362 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:31.970796 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-80158c7d-1c8e-4eb5-a545-16178a0a3362 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:31.971569 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-80158c7d-1c8e-4eb5-a545-16178a0a3362 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:31.971994 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-80158c7d-1c8e-4eb5-a545-16178a0a3362 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:32.103817 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-80158c7d-1c8e-4eb5-a545-16178a0a3362 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:32.111909 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-80158c7d-1c8e-4eb5-a545-16178a0a3362 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1520 microversion: 2.1 time: 0.153040 Oct 12 18:32:32.112632 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 432/871] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:31 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:32.617146 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-fa1f40ae-08b9-45c7-87c8-c3163ca72c3b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:32.617919 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-fa1f40ae-08b9-45c7-87c8-c3163ca72c3b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 527d2718-c3be-44f9-bf49-9c445e98cc75] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:32.624549 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a9a4c606-a172-4494-a7c5-473d72f0a1ae tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:32.625088 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fa1f40ae-08b9-45c7-87c8-c3163ca72c3b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:32.625201 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a9a4c606-a172-4494-a7c5-473d72f0a1ae tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:32.625560 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fa1f40ae-08b9-45c7-87c8-c3163ca72c3b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:32.626348 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fa1f40ae-08b9-45c7-87c8-c3163ca72c3b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:32.626851 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fa1f40ae-08b9-45c7-87c8-c3163ca72c3b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:32.631878 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a9a4c606-a172-4494-a7c5-473d72f0a1ae tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:32.651710 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a9a4c606-a172-4494-a7c5-473d72f0a1ae tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:32.651710 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a9a4c606-a172-4494-a7c5-473d72f0a1ae tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:32.651710 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a9a4c606-a172-4494-a7c5-473d72f0a1ae tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:32.817552 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-fa1f40ae-08b9-45c7-87c8-c3163ca72c3b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:32.820945 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a9a4c606-a172-4494-a7c5-473d72f0a1ae tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:32.826849 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-fa1f40ae-08b9-45c7-87c8-c3163ca72c3b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75" status: 200 len: 1266 microversion: 2.1 time: 0.213318 Oct 12 18:32:32.827771 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 440/872] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:32 2021] GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:32.829006 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a9a4c606-a172-4494-a7c5-473d72f0a1ae tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78" status: 200 len: 1549 microversion: 2.1 time: 0.208049 Oct 12 18:32:32.829573 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 433/873] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:32 2021] GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78 => generated 1549 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:32:32.849832 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-19f02f70-24a7-491a-9e84-8fa0e6052a32 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:32.850337 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-19f02f70-24a7-491a-9e84-8fa0e6052a32 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:32.856499 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-19f02f70-24a7-491a-9e84-8fa0e6052a32 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:32.856943 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-19f02f70-24a7-491a-9e84-8fa0e6052a32 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:32.857824 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-19f02f70-24a7-491a-9e84-8fa0e6052a32 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:32.858174 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-19f02f70-24a7-491a-9e84-8fa0e6052a32 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:32.924520 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c86110e5-0476-4ef0-8db6-60ad5b4c836d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:32.925933 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c86110e5-0476-4ef0-8db6-60ad5b4c836d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:32.932731 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c86110e5-0476-4ef0-8db6-60ad5b4c836d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:32.934258 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c86110e5-0476-4ef0-8db6-60ad5b4c836d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:32.935735 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c86110e5-0476-4ef0-8db6-60ad5b4c836d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:32.936450 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c86110e5-0476-4ef0-8db6-60ad5b4c836d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:32.955100 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-19f02f70-24a7-491a-9e84-8fa0e6052a32 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108931 Oct 12 18:32:32.955100 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 441/874] 10.222.0.18 () {58 vars in 1274 bytes} [Tue Oct 12 18:32:32 2021] GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:32:33.001198 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c86110e5-0476-4ef0-8db6-60ad5b4c836d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 14 microversion: 2.20 time: 0.080888 Oct 12 18:32:33.001981 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 434/875] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:32 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:33.129862 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-8afaae4a-f5a1-4763-9195-2bd683d13177 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:33.130673 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-8afaae4a-f5a1-4763-9195-2bd683d13177 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:33.137531 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8afaae4a-f5a1-4763-9195-2bd683d13177 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:33.138228 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8afaae4a-f5a1-4763-9195-2bd683d13177 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:33.139100 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8afaae4a-f5a1-4763-9195-2bd683d13177 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:33.139595 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8afaae4a-f5a1-4763-9195-2bd683d13177 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:33.286356 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-8afaae4a-f5a1-4763-9195-2bd683d13177 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:33.294648 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-8afaae4a-f5a1-4763-9195-2bd683d13177 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1520 microversion: 2.1 time: 0.168737 Oct 12 18:32:33.304593 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 442/876] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:33 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:33.846122 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-12df2573-202b-42f6-b88e-b59ca24a47c7 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:33.854245 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-12df2573-202b-42f6-b88e-b59ca24a47c7 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 527d2718-c3be-44f9-bf49-9c445e98cc75] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:33.865459 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-12df2573-202b-42f6-b88e-b59ca24a47c7 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:33.866297 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-12df2573-202b-42f6-b88e-b59ca24a47c7 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:33.867138 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-12df2573-202b-42f6-b88e-b59ca24a47c7 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:33.867727 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-12df2573-202b-42f6-b88e-b59ca24a47c7 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:34.016772 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-242bfcbf-1f59-4227-9150-b481a0afd8f9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:34.018405 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-242bfcbf-1f59-4227-9150-b481a0afd8f9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:34.026978 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-242bfcbf-1f59-4227-9150-b481a0afd8f9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:34.027607 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-242bfcbf-1f59-4227-9150-b481a0afd8f9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:34.040592 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-242bfcbf-1f59-4227-9150-b481a0afd8f9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:34.043422 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-242bfcbf-1f59-4227-9150-b481a0afd8f9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:34.099663 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-12df2573-202b-42f6-b88e-b59ca24a47c7 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:34.108381 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-12df2573-202b-42f6-b88e-b59ca24a47c7 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75" status: 200 len: 1266 microversion: 2.1 time: 0.266886 Oct 12 18:32:34.109008 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 435/877] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:33 2021] GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75 => generated 1266 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:32:34.113498 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b6e10073-7d6e-457b-a65e-bd9f4c4dbab0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:34.114457 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b6e10073-7d6e-457b-a65e-bd9f4c4dbab0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:34.121134 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b6e10073-7d6e-457b-a65e-bd9f4c4dbab0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:34.121582 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b6e10073-7d6e-457b-a65e-bd9f4c4dbab0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:34.122371 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b6e10073-7d6e-457b-a65e-bd9f4c4dbab0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:34.122794 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b6e10073-7d6e-457b-a65e-bd9f4c4dbab0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:34.196240 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-242bfcbf-1f59-4227-9150-b481a0afd8f9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 14 microversion: 2.20 time: 0.183948 Oct 12 18:32:34.197468 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 443/878] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:34 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 14 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:32:34.203455 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b6e10073-7d6e-457b-a65e-bd9f4c4dbab0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 14 microversion: 2.1 time: 0.093182 Oct 12 18:32:34.204600 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 436/879] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:32:34 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 18:32:34.206513 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-6ecc0124-ace4-4d84-b517-541c8346ea28 req-70635a0f-55a3-4b90-89f8-3a53cc30e1ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4adfbcc5-a227-49b4-aea6-24a58adcbd78", "tag": "5768eef0-c768-4c9b-af39-569bde13629c"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:34.208637 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:32:34.208637 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:32:34.216504 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-6ecc0124-ace4-4d84-b517-541c8346ea28 req-70635a0f-55a3-4b90-89f8-3a53cc30e1ab service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:34.218839 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-6ecc0124-ace4-4d84-b517-541c8346ea28 req-70635a0f-55a3-4b90-89f8-3a53cc30e1ab service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:34.232611 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-6ecc0124-ace4-4d84-b517-541c8346ea28 req-70635a0f-55a3-4b90-89f8-3a53cc30e1ab service nova] Creating event network-changed:5768eef0-c768-4c9b-af39-569bde13629c for instance 4adfbcc5-a227-49b4-aea6-24a58adcbd78 on hv-cinder-81322 Oct 12 18:32:34.237659 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-6ecc0124-ace4-4d84-b517-541c8346ea28 req-70635a0f-55a3-4b90-89f8-3a53cc30e1ab service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038082 Oct 12 18:32:34.238643 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 444/880] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:32:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:32:34.312020 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d2e50a0e-734c-4366-ad3a-4b556b436b05 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:34.312757 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d2e50a0e-734c-4366-ad3a-4b556b436b05 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:34.319644 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d2e50a0e-734c-4366-ad3a-4b556b436b05 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:34.320095 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d2e50a0e-734c-4366-ad3a-4b556b436b05 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:34.320933 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d2e50a0e-734c-4366-ad3a-4b556b436b05 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:34.321369 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d2e50a0e-734c-4366-ad3a-4b556b436b05 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:34.612914 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d2e50a0e-734c-4366-ad3a-4b556b436b05 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:34.621788 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d2e50a0e-734c-4366-ad3a-4b556b436b05 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1576 microversion: 2.1 time: 0.313703 Oct 12 18:32:34.622370 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 437/881] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:34 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1576 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:32:35.130108 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-f1cf45fc-1d05-4459-8566-f8116166346f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:35.130808 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-f1cf45fc-1d05-4459-8566-f8116166346f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 527d2718-c3be-44f9-bf49-9c445e98cc75] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:35.139559 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f1cf45fc-1d05-4459-8566-f8116166346f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:35.140278 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f1cf45fc-1d05-4459-8566-f8116166346f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:35.141493 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f1cf45fc-1d05-4459-8566-f8116166346f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:35.142175 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f1cf45fc-1d05-4459-8566-f8116166346f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:35.207339 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3546b19a-0f60-4826-9e13-56847261af3b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:35.210008 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3546b19a-0f60-4826-9e13-56847261af3b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:35.215437 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3546b19a-0f60-4826-9e13-56847261af3b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:35.215878 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3546b19a-0f60-4826-9e13-56847261af3b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:35.216985 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3546b19a-0f60-4826-9e13-56847261af3b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:35.217406 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3546b19a-0f60-4826-9e13-56847261af3b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:35.288062 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-f1cf45fc-1d05-4459-8566-f8116166346f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:35.299842 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-f1cf45fc-1d05-4459-8566-f8116166346f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75" status: 200 len: 1266 microversion: 2.1 time: 0.174460 Oct 12 18:32:35.299842 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 445/882] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:35 2021] GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:35.302870 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-2f5ebf18-67a6-4342-9e10-a1803a213c4f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:35.303826 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-2f5ebf18-67a6-4342-9e10-a1803a213c4f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:35.310381 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2f5ebf18-67a6-4342-9e10-a1803a213c4f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:35.310862 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2f5ebf18-67a6-4342-9e10-a1803a213c4f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:35.311663 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2f5ebf18-67a6-4342-9e10-a1803a213c4f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:35.312211 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2f5ebf18-67a6-4342-9e10-a1803a213c4f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:35.332226 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3546b19a-0f60-4826-9e13-56847261af3b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 9749 microversion: 2.20 time: 0.128498 Oct 12 18:32:35.333186 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 438/883] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:35 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 9749 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:32:35.460057 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-2f5ebf18-67a6-4342-9e10-a1803a213c4f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 14 microversion: 2.1 time: 0.160482 Oct 12 18:32:35.460639 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 446/884] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:32:35 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 18:32:35.643638 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e005be47-ee65-4bb4-8747-6ae4aa68ea72 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:35.644327 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e005be47-ee65-4bb4-8747-6ae4aa68ea72 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:35.651375 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e005be47-ee65-4bb4-8747-6ae4aa68ea72 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:35.654231 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e005be47-ee65-4bb4-8747-6ae4aa68ea72 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:35.654231 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e005be47-ee65-4bb4-8747-6ae4aa68ea72 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:35.654231 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e005be47-ee65-4bb4-8747-6ae4aa68ea72 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:35.776327 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e005be47-ee65-4bb4-8747-6ae4aa68ea72 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:35.784163 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e005be47-ee65-4bb4-8747-6ae4aa68ea72 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1576 microversion: 2.1 time: 0.144714 Oct 12 18:32:35.784777 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 439/885] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:35 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1576 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:36.315727 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-6dfbcadd-659e-43e7-8e52-bbd431c8bf81 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:36.316505 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-6dfbcadd-659e-43e7-8e52-bbd431c8bf81 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 527d2718-c3be-44f9-bf49-9c445e98cc75] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:36.323996 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6dfbcadd-659e-43e7-8e52-bbd431c8bf81 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:36.324462 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6dfbcadd-659e-43e7-8e52-bbd431c8bf81 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:36.325232 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6dfbcadd-659e-43e7-8e52-bbd431c8bf81 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:36.325657 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6dfbcadd-659e-43e7-8e52-bbd431c8bf81 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:36.343151 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e80a8ec7-2ec7-46da-8543-0e9fa47f6551 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:36.344116 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e80a8ec7-2ec7-46da-8543-0e9fa47f6551 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:36.349884 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e80a8ec7-2ec7-46da-8543-0e9fa47f6551 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:36.350327 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e80a8ec7-2ec7-46da-8543-0e9fa47f6551 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:36.361047 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e80a8ec7-2ec7-46da-8543-0e9fa47f6551 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:36.361047 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e80a8ec7-2ec7-46da-8543-0e9fa47f6551 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:36.434051 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e80a8ec7-2ec7-46da-8543-0e9fa47f6551 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 16280 microversion: 2.20 time: 0.094408 Oct 12 18:32:36.434709 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 440/886] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:36 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 16280 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:32:36.455676 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-6dfbcadd-659e-43e7-8e52-bbd431c8bf81 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:36.463376 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-6dfbcadd-659e-43e7-8e52-bbd431c8bf81 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75" status: 200 len: 1266 microversion: 2.1 time: 0.151746 Oct 12 18:32:36.463953 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 447/887] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:36 2021] GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:36.471693 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c7fa8cf1-c70b-442a-b0e3-52d9d81f7d98 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:36.472738 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c7fa8cf1-c70b-442a-b0e3-52d9d81f7d98 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:36.487536 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c7fa8cf1-c70b-442a-b0e3-52d9d81f7d98 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:36.487988 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c7fa8cf1-c70b-442a-b0e3-52d9d81f7d98 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:36.488827 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c7fa8cf1-c70b-442a-b0e3-52d9d81f7d98 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:36.489257 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c7fa8cf1-c70b-442a-b0e3-52d9d81f7d98 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:36.551998 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c7fa8cf1-c70b-442a-b0e3-52d9d81f7d98 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 14 microversion: 2.1 time: 0.084212 Oct 12 18:32:36.552827 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 441/888] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:32:36 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 18:32:36.801699 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-41bd2551-853d-4273-94c2-dc3e9e3472dd tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:36.802302 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-41bd2551-853d-4273-94c2-dc3e9e3472dd tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:36.808673 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-41bd2551-853d-4273-94c2-dc3e9e3472dd tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:36.809111 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-41bd2551-853d-4273-94c2-dc3e9e3472dd tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:36.809869 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-41bd2551-853d-4273-94c2-dc3e9e3472dd tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:36.810294 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-41bd2551-853d-4273-94c2-dc3e9e3472dd tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:36.937713 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-41bd2551-853d-4273-94c2-dc3e9e3472dd tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:36.945204 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-41bd2551-853d-4273-94c2-dc3e9e3472dd tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1576 microversion: 2.1 time: 0.147061 Oct 12 18:32:36.945749 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 448/889] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:36 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1576 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:37.448663 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9c3e80c5-7bcd-49a6-9e7f-86f9e9cc3e27 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:37.449727 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9c3e80c5-7bcd-49a6-9e7f-86f9e9cc3e27 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:37.460258 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9c3e80c5-7bcd-49a6-9e7f-86f9e9cc3e27 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:37.461014 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9c3e80c5-7bcd-49a6-9e7f-86f9e9cc3e27 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:37.462264 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9c3e80c5-7bcd-49a6-9e7f-86f9e9cc3e27 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:37.463587 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9c3e80c5-7bcd-49a6-9e7f-86f9e9cc3e27 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:37.483504 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-12665d13-c04a-45e2-af33-678f59d8b89b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:37.484722 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-12665d13-c04a-45e2-af33-678f59d8b89b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 527d2718-c3be-44f9-bf49-9c445e98cc75] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:37.492083 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-12665d13-c04a-45e2-af33-678f59d8b89b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:37.493621 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-12665d13-c04a-45e2-af33-678f59d8b89b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:37.495478 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-12665d13-c04a-45e2-af33-678f59d8b89b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:37.496342 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-12665d13-c04a-45e2-af33-678f59d8b89b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:37.546256 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9c3e80c5-7bcd-49a6-9e7f-86f9e9cc3e27 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 18561 microversion: 2.20 time: 0.103700 Oct 12 18:32:37.548533 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 442/890] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:37 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 18561 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:32:37.564513 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-fa72f087-d530-4d5a-a3b8-fb50d1d77a19 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:37.565525 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-fa72f087-d530-4d5a-a3b8-fb50d1d77a19 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:37.574632 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fa72f087-d530-4d5a-a3b8-fb50d1d77a19 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:37.575077 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fa72f087-d530-4d5a-a3b8-fb50d1d77a19 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:37.575858 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fa72f087-d530-4d5a-a3b8-fb50d1d77a19 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:37.576280 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fa72f087-d530-4d5a-a3b8-fb50d1d77a19 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:37.642896 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-fa72f087-d530-4d5a-a3b8-fb50d1d77a19 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 14 microversion: 2.1 time: 0.082177 Oct 12 18:32:37.644267 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 443/891] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:32:37 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 18:32:37.770096 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-1f915a9c-de3d-440c-ab8a-63cb3f05c67a req-48f632be-b252-4c84-b74c-c522ed25e851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "527d2718-c3be-44f9-bf49-9c445e98cc75", "name": "network-vif-plugged", "status": "completed", "tag": "260f73ad-348d-4e3f-8940-94a948e1eaae"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:37.771972 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:32:37.771972 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:32:37.781007 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-1f915a9c-de3d-440c-ab8a-63cb3f05c67a req-48f632be-b252-4c84-b74c-c522ed25e851 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:37.781456 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-1f915a9c-de3d-440c-ab8a-63cb3f05c67a req-48f632be-b252-4c84-b74c-c522ed25e851 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:37.794194 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-1f915a9c-de3d-440c-ab8a-63cb3f05c67a req-48f632be-b252-4c84-b74c-c522ed25e851 service nova] Creating event network-vif-plugged:260f73ad-348d-4e3f-8940-94a948e1eaae for instance 527d2718-c3be-44f9-bf49-9c445e98cc75 on hv-cinder-81322 Oct 12 18:32:37.811071 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-1f915a9c-de3d-440c-ab8a-63cb3f05c67a req-48f632be-b252-4c84-b74c-c522ed25e851 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033646 Oct 12 18:32:37.811071 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 444/892] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:32:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 18:32:37.868442 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-12665d13-c04a-45e2-af33-678f59d8b89b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:37.876370 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-12665d13-c04a-45e2-af33-678f59d8b89b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75" status: 200 len: 1266 microversion: 2.1 time: 0.398868 Oct 12 18:32:37.876984 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 449/893] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:37 2021] GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75 => generated 1266 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:37.965252 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ae345de8-1866-40cf-8e20-6e424fe41759 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:37.966218 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ae345de8-1866-40cf-8e20-6e424fe41759 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:37.973839 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ae345de8-1866-40cf-8e20-6e424fe41759 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:37.974284 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ae345de8-1866-40cf-8e20-6e424fe41759 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:37.975056 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ae345de8-1866-40cf-8e20-6e424fe41759 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:37.975484 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ae345de8-1866-40cf-8e20-6e424fe41759 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:38.100009 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ae345de8-1866-40cf-8e20-6e424fe41759 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:38.108460 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ae345de8-1866-40cf-8e20-6e424fe41759 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1576 microversion: 2.1 time: 0.150443 Oct 12 18:32:38.109036 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 445/894] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:37 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:38.558146 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-e3d4981a-2eff-4d71-a921-02d55fd0e06e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:38.559095 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-e3d4981a-2eff-4d71-a921-02d55fd0e06e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:38.565750 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e3d4981a-2eff-4d71-a921-02d55fd0e06e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:38.566194 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e3d4981a-2eff-4d71-a921-02d55fd0e06e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:38.566971 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e3d4981a-2eff-4d71-a921-02d55fd0e06e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:38.567410 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e3d4981a-2eff-4d71-a921-02d55fd0e06e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:38.642693 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-e3d4981a-2eff-4d71-a921-02d55fd0e06e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 20074 microversion: 2.20 time: 0.088648 Oct 12 18:32:38.643326 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 450/895] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:38 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 20074 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:32:38.654832 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0c91c368-5598-46c3-a016-4278f0287bb2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:38.655834 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0c91c368-5598-46c3-a016-4278f0287bb2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:38.661667 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0c91c368-5598-46c3-a016-4278f0287bb2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:38.662106 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0c91c368-5598-46c3-a016-4278f0287bb2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:38.662869 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0c91c368-5598-46c3-a016-4278f0287bb2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:38.663298 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0c91c368-5598-46c3-a016-4278f0287bb2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:38.728475 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0c91c368-5598-46c3-a016-4278f0287bb2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 14 microversion: 2.1 time: 0.077055 Oct 12 18:32:38.729448 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 446/896] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:32:38 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 18:32:38.893695 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-2a168297-5320-4fd3-9761-e327c96325f4 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:38.894295 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-2a168297-5320-4fd3-9761-e327c96325f4 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 527d2718-c3be-44f9-bf49-9c445e98cc75] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:38.900799 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2a168297-5320-4fd3-9761-e327c96325f4 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:38.901269 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2a168297-5320-4fd3-9761-e327c96325f4 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:38.902232 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2a168297-5320-4fd3-9761-e327c96325f4 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:38.902754 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2a168297-5320-4fd3-9761-e327c96325f4 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:39.034065 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-2a168297-5320-4fd3-9761-e327c96325f4 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:39.041519 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-2a168297-5320-4fd3-9761-e327c96325f4 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75" status: 200 len: 1266 microversion: 2.1 time: 0.151740 Oct 12 18:32:39.042097 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 451/897] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:38 2021] GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:39.126555 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9ef61a73-4b01-4244-b2c0-617ba95a990b tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:39.127246 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9ef61a73-4b01-4244-b2c0-617ba95a990b tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:39.133979 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9ef61a73-4b01-4244-b2c0-617ba95a990b tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:39.134420 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9ef61a73-4b01-4244-b2c0-617ba95a990b tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:39.135214 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9ef61a73-4b01-4244-b2c0-617ba95a990b tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:39.135638 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9ef61a73-4b01-4244-b2c0-617ba95a990b tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:39.262212 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9ef61a73-4b01-4244-b2c0-617ba95a990b tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:39.270514 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9ef61a73-4b01-4244-b2c0-617ba95a990b tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1576 microversion: 2.1 time: 0.147871 Oct 12 18:32:39.271098 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 447/898] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:39 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:39.655382 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-67f04127-dcb6-450f-a69c-e8e18ec2f008 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:39.656325 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-67f04127-dcb6-450f-a69c-e8e18ec2f008 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:39.662350 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-67f04127-dcb6-450f-a69c-e8e18ec2f008 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:39.662847 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-67f04127-dcb6-450f-a69c-e8e18ec2f008 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:39.663790 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-67f04127-dcb6-450f-a69c-e8e18ec2f008 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:39.664154 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-67f04127-dcb6-450f-a69c-e8e18ec2f008 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:39.740056 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4a3cc6d4-d61b-41bd-a18d-5502dea5dbc5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:39.741048 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4a3cc6d4-d61b-41bd-a18d-5502dea5dbc5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:39.747065 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4a3cc6d4-d61b-41bd-a18d-5502dea5dbc5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:39.747510 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4a3cc6d4-d61b-41bd-a18d-5502dea5dbc5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:39.748286 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4a3cc6d4-d61b-41bd-a18d-5502dea5dbc5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:39.748755 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4a3cc6d4-d61b-41bd-a18d-5502dea5dbc5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:39.758793 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-67f04127-dcb6-450f-a69c-e8e18ec2f008 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 22162 microversion: 2.20 time: 0.108069 Oct 12 18:32:39.764321 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 452/899] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:39 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 22162 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:32:39.821198 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4a3cc6d4-d61b-41bd-a18d-5502dea5dbc5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 14 microversion: 2.1 time: 0.085097 Oct 12 18:32:39.821970 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 448/900] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:32:39 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 18:32:40.059648 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-206df8fc-7aa3-4f0e-a28a-ec4dc2095eb7 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:40.060447 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-206df8fc-7aa3-4f0e-a28a-ec4dc2095eb7 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 527d2718-c3be-44f9-bf49-9c445e98cc75] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:40.067280 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-206df8fc-7aa3-4f0e-a28a-ec4dc2095eb7 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:40.067743 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-206df8fc-7aa3-4f0e-a28a-ec4dc2095eb7 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:40.068747 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-206df8fc-7aa3-4f0e-a28a-ec4dc2095eb7 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:40.069183 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-206df8fc-7aa3-4f0e-a28a-ec4dc2095eb7 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:40.197356 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-206df8fc-7aa3-4f0e-a28a-ec4dc2095eb7 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:40.205302 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-206df8fc-7aa3-4f0e-a28a-ec4dc2095eb7 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75" status: 200 len: 1453 microversion: 2.1 time: 0.150287 Oct 12 18:32:40.205868 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 453/901] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:40 2021] GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:32:40.222272 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-148976ef-3e3b-4579-abc4-d8e6e9e9dc8b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:40.222965 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-148976ef-3e3b-4579-abc4-d8e6e9e9dc8b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 527d2718-c3be-44f9-bf49-9c445e98cc75] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:40.230234 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-148976ef-3e3b-4579-abc4-d8e6e9e9dc8b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:40.230670 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-148976ef-3e3b-4579-abc4-d8e6e9e9dc8b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:40.231426 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-148976ef-3e3b-4579-abc4-d8e6e9e9dc8b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:40.231855 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-148976ef-3e3b-4579-abc4-d8e6e9e9dc8b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:40.289153 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-624e1637-1037-4e4e-b15b-73d6328a90f3 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:40.289753 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-624e1637-1037-4e4e-b15b-73d6328a90f3 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:40.296307 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-624e1637-1037-4e4e-b15b-73d6328a90f3 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:40.296764 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-624e1637-1037-4e4e-b15b-73d6328a90f3 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:40.297544 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-624e1637-1037-4e4e-b15b-73d6328a90f3 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:40.298040 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-624e1637-1037-4e4e-b15b-73d6328a90f3 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:40.396603 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-148976ef-3e3b-4579-abc4-d8e6e9e9dc8b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:40.405107 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-148976ef-3e3b-4579-abc4-d8e6e9e9dc8b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75" status: 200 len: 1453 microversion: 2.1 time: 0.186690 Oct 12 18:32:40.405898 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 449/902] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:40 2021] GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75 => generated 1453 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:40.465441 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-624e1637-1037-4e4e-b15b-73d6328a90f3 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:40.475363 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-624e1637-1037-4e4e-b15b-73d6328a90f3 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1576 microversion: 2.1 time: 0.189306 Oct 12 18:32:40.486643 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 454/903] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:40 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1576 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:32:40.772968 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e76197ba-fe27-45cd-b997-cb8ddd3f47f4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:40.773905 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e76197ba-fe27-45cd-b997-cb8ddd3f47f4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:40.780559 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e76197ba-fe27-45cd-b997-cb8ddd3f47f4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:40.807244 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e76197ba-fe27-45cd-b997-cb8ddd3f47f4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:40.807244 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e76197ba-fe27-45cd-b997-cb8ddd3f47f4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:40.807244 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e76197ba-fe27-45cd-b997-cb8ddd3f47f4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:40.834652 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-1f24314d-d105-424c-a363-48c6eb75337a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:40.836168 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-1f24314d-d105-424c-a363-48c6eb75337a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:40.848800 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1f24314d-d105-424c-a363-48c6eb75337a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:40.849603 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1f24314d-d105-424c-a363-48c6eb75337a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:40.850864 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1f24314d-d105-424c-a363-48c6eb75337a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:40.851660 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1f24314d-d105-424c-a363-48c6eb75337a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:40.859268 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e76197ba-fe27-45cd-b997-cb8ddd3f47f4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 23558 microversion: 2.20 time: 0.089565 Oct 12 18:32:40.859946 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 450/904] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:40 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 23558 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:32:40.935441 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-1f24314d-d105-424c-a363-48c6eb75337a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 14 microversion: 2.1 time: 0.104708 Oct 12 18:32:40.938523 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 455/905] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:32:40 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 18:32:41.493651 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b5122f44-3e01-42ff-8971-17d78cccfc2c tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:41.494852 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b5122f44-3e01-42ff-8971-17d78cccfc2c tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:41.501488 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b5122f44-3e01-42ff-8971-17d78cccfc2c tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:41.501931 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b5122f44-3e01-42ff-8971-17d78cccfc2c tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:41.502714 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b5122f44-3e01-42ff-8971-17d78cccfc2c tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:41.503138 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b5122f44-3e01-42ff-8971-17d78cccfc2c tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:41.672943 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b5122f44-3e01-42ff-8971-17d78cccfc2c tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:41.684003 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b5122f44-3e01-42ff-8971-17d78cccfc2c tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1576 microversion: 2.1 time: 0.194531 Oct 12 18:32:41.684629 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 451/906] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:41 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1576 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:41.875317 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-aeb0b8e4-5d2d-4797-a6c4-443c83ad97ec tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:41.876436 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-aeb0b8e4-5d2d-4797-a6c4-443c83ad97ec tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:41.883505 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-aeb0b8e4-5d2d-4797-a6c4-443c83ad97ec tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:41.884071 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-aeb0b8e4-5d2d-4797-a6c4-443c83ad97ec tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:41.885521 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-aeb0b8e4-5d2d-4797-a6c4-443c83ad97ec tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:41.885861 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-aeb0b8e4-5d2d-4797-a6c4-443c83ad97ec tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:41.947347 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-04dc75c0-3762-40a4-87a5-a5c669f9a665 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:41.948210 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-04dc75c0-3762-40a4-87a5-a5c669f9a665 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:41.955660 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-04dc75c0-3762-40a4-87a5-a5c669f9a665 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:41.955660 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-04dc75c0-3762-40a4-87a5-a5c669f9a665 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:41.955660 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-04dc75c0-3762-40a4-87a5-a5c669f9a665 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:41.956027 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-04dc75c0-3762-40a4-87a5-a5c669f9a665 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:41.974146 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-aeb0b8e4-5d2d-4797-a6c4-443c83ad97ec tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 24745 microversion: 2.20 time: 0.103061 Oct 12 18:32:41.975109 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 456/907] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:41 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 24745 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:32:42.021638 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-04dc75c0-3762-40a4-87a5-a5c669f9a665 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 14 microversion: 2.1 time: 0.077824 Oct 12 18:32:42.022979 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 452/908] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:32:41 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 18:32:42.504641 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-9b423b74-c927-45a4-92b9-311ff9d18cdd req-320ead0c-574a-48a4-a5c6-15c8379b4e4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "527d2718-c3be-44f9-bf49-9c445e98cc75", "tag": "260f73ad-348d-4e3f-8940-94a948e1eaae"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:42.508149 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:32:42.508149 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:32:42.521367 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-9b423b74-c927-45a4-92b9-311ff9d18cdd req-320ead0c-574a-48a4-a5c6-15c8379b4e4c service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:42.522157 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-9b423b74-c927-45a4-92b9-311ff9d18cdd req-320ead0c-574a-48a4-a5c6-15c8379b4e4c service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:42.547578 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-9b423b74-c927-45a4-92b9-311ff9d18cdd req-320ead0c-574a-48a4-a5c6-15c8379b4e4c service nova] Creating event network-changed:260f73ad-348d-4e3f-8940-94a948e1eaae for instance 527d2718-c3be-44f9-bf49-9c445e98cc75 on hv-cinder-81322 Oct 12 18:32:42.552473 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-9b423b74-c927-45a4-92b9-311ff9d18cdd req-320ead0c-574a-48a4-a5c6-15c8379b4e4c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054996 Oct 12 18:32:42.553125 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 457/909] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:32:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 18:32:42.702522 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9eaaf397-5f81-4442-8dbc-ce0ce89a02a2 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:42.703234 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9eaaf397-5f81-4442-8dbc-ce0ce89a02a2 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:42.710063 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9eaaf397-5f81-4442-8dbc-ce0ce89a02a2 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:42.710786 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9eaaf397-5f81-4442-8dbc-ce0ce89a02a2 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:42.711771 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9eaaf397-5f81-4442-8dbc-ce0ce89a02a2 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:42.712422 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9eaaf397-5f81-4442-8dbc-ce0ce89a02a2 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:42.946196 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9eaaf397-5f81-4442-8dbc-ce0ce89a02a2 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:42.954415 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9eaaf397-5f81-4442-8dbc-ce0ce89a02a2 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1576 microversion: 2.1 time: 0.256435 Oct 12 18:32:42.955324 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 453/910] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:42 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1576 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:42.988955 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-7ae33014-8dd5-470c-8dde-2266110cf940 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:42.989950 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-7ae33014-8dd5-470c-8dde-2266110cf940 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:42.997855 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7ae33014-8dd5-470c-8dde-2266110cf940 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:42.998296 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7ae33014-8dd5-470c-8dde-2266110cf940 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:42.999064 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7ae33014-8dd5-470c-8dde-2266110cf940 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:42.999487 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7ae33014-8dd5-470c-8dde-2266110cf940 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:43.038033 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4aab0999-637a-42f3-933a-f093bf7a2694 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:43.039578 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4aab0999-637a-42f3-933a-f093bf7a2694 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:43.046312 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4aab0999-637a-42f3-933a-f093bf7a2694 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:43.046763 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4aab0999-637a-42f3-933a-f093bf7a2694 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:43.047554 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4aab0999-637a-42f3-933a-f093bf7a2694 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:43.047987 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4aab0999-637a-42f3-933a-f093bf7a2694 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:43.092957 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-7ae33014-8dd5-470c-8dde-2266110cf940 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 26235 microversion: 2.20 time: 0.109541 Oct 12 18:32:43.098067 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 458/911] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:42 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 26235 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:32:43.133611 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4aab0999-637a-42f3-933a-f093bf7a2694 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 14 microversion: 2.1 time: 0.102308 Oct 12 18:32:43.135798 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 454/912] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:32:43 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 18:32:43.971896 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-7e13863b-e181-4eb3-ae8f-addd0de1c2a5 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:43.972895 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-7e13863b-e181-4eb3-ae8f-addd0de1c2a5 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:43.980161 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7e13863b-e181-4eb3-ae8f-addd0de1c2a5 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:43.980655 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7e13863b-e181-4eb3-ae8f-addd0de1c2a5 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:43.981448 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7e13863b-e181-4eb3-ae8f-addd0de1c2a5 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:43.981877 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7e13863b-e181-4eb3-ae8f-addd0de1c2a5 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:44.105727 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-32afae33-d9e3-4f93-b065-21ff33ea0437 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:44.106733 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-32afae33-d9e3-4f93-b065-21ff33ea0437 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:44.115711 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-32afae33-d9e3-4f93-b065-21ff33ea0437 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:44.116562 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-32afae33-d9e3-4f93-b065-21ff33ea0437 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:44.117877 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-32afae33-d9e3-4f93-b065-21ff33ea0437 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:44.118603 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-32afae33-d9e3-4f93-b065-21ff33ea0437 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:44.124514 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-7e13863b-e181-4eb3-ae8f-addd0de1c2a5 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:44.132059 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-7e13863b-e181-4eb3-ae8f-addd0de1c2a5 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1576 microversion: 2.1 time: 0.164153 Oct 12 18:32:44.132672 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 459/913] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:43 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:44.145724 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-0e71144b-f9a7-4bf1-92c4-c569f97cc5fc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:44.146721 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-0e71144b-f9a7-4bf1-92c4-c569f97cc5fc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:44.153288 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0e71144b-f9a7-4bf1-92c4-c569f97cc5fc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:44.154069 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0e71144b-f9a7-4bf1-92c4-c569f97cc5fc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:44.154945 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0e71144b-f9a7-4bf1-92c4-c569f97cc5fc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:44.156126 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0e71144b-f9a7-4bf1-92c4-c569f97cc5fc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:44.203581 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-32afae33-d9e3-4f93-b065-21ff33ea0437 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 27177 microversion: 2.20 time: 0.101866 Oct 12 18:32:44.204269 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 455/914] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:44 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 27177 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:32:44.231022 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-0e71144b-f9a7-4bf1-92c4-c569f97cc5fc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 14 microversion: 2.1 time: 0.089062 Oct 12 18:32:44.231678 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 460/915] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:32:44 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 18:32:45.151402 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a5812060-f22b-4427-a35f-68b37063bb93 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:45.152075 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a5812060-f22b-4427-a35f-68b37063bb93 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:45.159513 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a5812060-f22b-4427-a35f-68b37063bb93 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:45.159961 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a5812060-f22b-4427-a35f-68b37063bb93 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:45.162720 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a5812060-f22b-4427-a35f-68b37063bb93 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:45.162720 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a5812060-f22b-4427-a35f-68b37063bb93 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:45.216710 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-7c5629a8-1daa-4ff1-8468-9b96ece1c7f0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:45.217821 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-7c5629a8-1daa-4ff1-8468-9b96ece1c7f0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:45.224886 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7c5629a8-1daa-4ff1-8468-9b96ece1c7f0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:45.225360 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7c5629a8-1daa-4ff1-8468-9b96ece1c7f0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:45.226131 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7c5629a8-1daa-4ff1-8468-9b96ece1c7f0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:45.226558 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7c5629a8-1daa-4ff1-8468-9b96ece1c7f0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:45.299529 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a5812060-f22b-4427-a35f-68b37063bb93 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:45.308449 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a5812060-f22b-4427-a35f-68b37063bb93 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1576 microversion: 2.1 time: 0.161734 Oct 12 18:32:45.309037 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 456/916] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:45 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:45.313396 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-84a59ac8-d920-416a-94a4-595bb49f7973 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:45.314288 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-84a59ac8-d920-416a-94a4-595bb49f7973 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:45.320166 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-84a59ac8-d920-416a-94a4-595bb49f7973 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:45.320643 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-84a59ac8-d920-416a-94a4-595bb49f7973 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:45.321407 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-84a59ac8-d920-416a-94a4-595bb49f7973 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:45.321846 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-84a59ac8-d920-416a-94a4-595bb49f7973 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:45.334941 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-7c5629a8-1daa-4ff1-8468-9b96ece1c7f0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 27629 microversion: 2.20 time: 0.122964 Oct 12 18:32:45.335850 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 461/917] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:45 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 27629 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:32:45.392689 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-84a59ac8-d920-416a-94a4-595bb49f7973 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 14 microversion: 2.1 time: 0.082393 Oct 12 18:32:45.393320 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 457/918] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:32:45 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 18:32:45.681347 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-5cdbdcd3-6730-41e9-8a46-9eb752a73155 req-b9071f96-a464-4521-8f05-2221c0635710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f0cf04d-323c-4749-b9ae-d35333eb565c", "name": "network-vif-plugged", "status": "completed", "tag": "ee9e0115-2251-43e7-8da4-8dd846258e7b"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:45.683076 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:32:45.683076 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:32:45.690990 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-5cdbdcd3-6730-41e9-8a46-9eb752a73155 req-b9071f96-a464-4521-8f05-2221c0635710 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:45.691436 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-5cdbdcd3-6730-41e9-8a46-9eb752a73155 req-b9071f96-a464-4521-8f05-2221c0635710 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:45.708588 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-5cdbdcd3-6730-41e9-8a46-9eb752a73155 req-b9071f96-a464-4521-8f05-2221c0635710 service nova] Creating event network-vif-plugged:ee9e0115-2251-43e7-8da4-8dd846258e7b for instance 1f0cf04d-323c-4749-b9ae-d35333eb565c on hv-cinder-81322 Oct 12 18:32:45.714804 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-5cdbdcd3-6730-41e9-8a46-9eb752a73155 req-b9071f96-a464-4521-8f05-2221c0635710 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037547 Oct 12 18:32:45.715420 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 462/919] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:32:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:32:46.328036 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8de0a6dc-ea3b-4a17-b326-3a4ad32e05a1 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:46.328759 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8de0a6dc-ea3b-4a17-b326-3a4ad32e05a1 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:46.335385 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8de0a6dc-ea3b-4a17-b326-3a4ad32e05a1 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:46.335835 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8de0a6dc-ea3b-4a17-b326-3a4ad32e05a1 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:46.336640 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8de0a6dc-ea3b-4a17-b326-3a4ad32e05a1 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:46.337078 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8de0a6dc-ea3b-4a17-b326-3a4ad32e05a1 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:46.349995 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-ecb90f7d-90ab-4a1c-82d8-759cbc329ecb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:46.351873 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-ecb90f7d-90ab-4a1c-82d8-759cbc329ecb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:46.361750 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ecb90f7d-90ab-4a1c-82d8-759cbc329ecb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:46.362473 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ecb90f7d-90ab-4a1c-82d8-759cbc329ecb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:46.363783 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ecb90f7d-90ab-4a1c-82d8-759cbc329ecb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:46.364489 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ecb90f7d-90ab-4a1c-82d8-759cbc329ecb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:46.476192 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-ecb90f7d-90ab-4a1c-82d8-759cbc329ecb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 27879 microversion: 2.20 time: 0.132067 Oct 12 18:32:46.476976 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 463/920] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:46 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 27879 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:32:46.482410 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-a3a2eb9f-19cd-4add-906d-8a588e63c87e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:46.483571 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-a3a2eb9f-19cd-4add-906d-8a588e63c87e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:46.491622 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a3a2eb9f-19cd-4add-906d-8a588e63c87e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:46.492093 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a3a2eb9f-19cd-4add-906d-8a588e63c87e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:46.492923 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a3a2eb9f-19cd-4add-906d-8a588e63c87e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:46.493454 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a3a2eb9f-19cd-4add-906d-8a588e63c87e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:46.495633 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8de0a6dc-ea3b-4a17-b326-3a4ad32e05a1 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:46.503502 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8de0a6dc-ea3b-4a17-b326-3a4ad32e05a1 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1576 microversion: 2.1 time: 0.181246 Oct 12 18:32:46.504165 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 458/921] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:46 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1576 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:46.604656 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-a3a2eb9f-19cd-4add-906d-8a588e63c87e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 6451 microversion: 2.1 time: 0.126114 Oct 12 18:32:46.605294 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 464/922] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:32:46 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 6451 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:47.492082 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9dc702dc-949f-4f3f-909b-9ef699f877c1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:47.493300 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9dc702dc-949f-4f3f-909b-9ef699f877c1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:47.501846 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9dc702dc-949f-4f3f-909b-9ef699f877c1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:47.502546 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9dc702dc-949f-4f3f-909b-9ef699f877c1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:47.503953 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9dc702dc-949f-4f3f-909b-9ef699f877c1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:47.504869 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9dc702dc-949f-4f3f-909b-9ef699f877c1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:47.524634 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-b39fa7d7-70ba-4275-b2ce-a32cc496752a tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:47.526478 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-b39fa7d7-70ba-4275-b2ce-a32cc496752a tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:47.541125 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b39fa7d7-70ba-4275-b2ce-a32cc496752a tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:47.543181 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b39fa7d7-70ba-4275-b2ce-a32cc496752a tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:47.543181 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b39fa7d7-70ba-4275-b2ce-a32cc496752a tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:47.543181 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b39fa7d7-70ba-4275-b2ce-a32cc496752a tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:47.612543 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9dc702dc-949f-4f3f-909b-9ef699f877c1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28174 microversion: 2.20 time: 0.127855 Oct 12 18:32:47.617162 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 459/923] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:47 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28174 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:32:47.622059 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0315b323-996d-4be4-97fc-d9431f2e0b41 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:47.622334 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0315b323-996d-4be4-97fc-d9431f2e0b41 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:47.629245 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0315b323-996d-4be4-97fc-d9431f2e0b41 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:47.629692 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0315b323-996d-4be4-97fc-d9431f2e0b41 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:47.630477 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0315b323-996d-4be4-97fc-d9431f2e0b41 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:47.630906 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0315b323-996d-4be4-97fc-d9431f2e0b41 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:47.714160 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0315b323-996d-4be4-97fc-d9431f2e0b41 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 12982 microversion: 2.1 time: 0.097989 Oct 12 18:32:47.715932 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 460/924] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:32:47 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 12982 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:32:47.745976 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-b39fa7d7-70ba-4275-b2ce-a32cc496752a tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:47.754264 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-b39fa7d7-70ba-4275-b2ce-a32cc496752a tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1576 microversion: 2.1 time: 0.234513 Oct 12 18:32:47.754843 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 465/925] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:47 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1576 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:32:48.625527 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-68f8d12f-e768-431a-bf22-cd6c849b575a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:48.626519 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-68f8d12f-e768-431a-bf22-cd6c849b575a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:48.633101 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-68f8d12f-e768-431a-bf22-cd6c849b575a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:48.633542 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-68f8d12f-e768-431a-bf22-cd6c849b575a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:48.634324 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-68f8d12f-e768-431a-bf22-cd6c849b575a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:48.634940 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-68f8d12f-e768-431a-bf22-cd6c849b575a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:48.707694 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-68f8d12f-e768-431a-bf22-cd6c849b575a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28174 microversion: 2.20 time: 0.086115 Oct 12 18:32:48.711255 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 461/926] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:48 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28174 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:32:48.726240 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-f02b0dce-6f04-4e09-b965-729d9ca553ad tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:48.727252 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-f02b0dce-6f04-4e09-b965-729d9ca553ad tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:48.734365 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f02b0dce-6f04-4e09-b965-729d9ca553ad tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:48.734810 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f02b0dce-6f04-4e09-b965-729d9ca553ad tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:48.735671 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f02b0dce-6f04-4e09-b965-729d9ca553ad tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:48.736102 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f02b0dce-6f04-4e09-b965-729d9ca553ad tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:48.772919 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-97f155b1-4e70-4e0e-8b30-da6ce9272ffe tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:48.773694 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-97f155b1-4e70-4e0e-8b30-da6ce9272ffe tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:48.781411 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-97f155b1-4e70-4e0e-8b30-da6ce9272ffe tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:48.781851 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-97f155b1-4e70-4e0e-8b30-da6ce9272ffe tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:48.782656 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-97f155b1-4e70-4e0e-8b30-da6ce9272ffe tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:48.783029 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-97f155b1-4e70-4e0e-8b30-da6ce9272ffe tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:48.806531 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-f02b0dce-6f04-4e09-b965-729d9ca553ad tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 18561 microversion: 2.1 time: 0.084137 Oct 12 18:32:48.810185 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 466/927] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:32:48 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 18561 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:32:48.913072 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-97f155b1-4e70-4e0e-8b30-da6ce9272ffe tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:48.920988 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-97f155b1-4e70-4e0e-8b30-da6ce9272ffe tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1563 microversion: 2.1 time: 0.152198 Oct 12 18:32:48.921677 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 462/928] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:48 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:49.721172 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c04a6b5f-cdf3-4ac9-b4fd-f8430a8d72e5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:49.722162 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c04a6b5f-cdf3-4ac9-b4fd-f8430a8d72e5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:49.728786 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c04a6b5f-cdf3-4ac9-b4fd-f8430a8d72e5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:49.729325 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c04a6b5f-cdf3-4ac9-b4fd-f8430a8d72e5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:49.729976 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c04a6b5f-cdf3-4ac9-b4fd-f8430a8d72e5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:49.731531 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c04a6b5f-cdf3-4ac9-b4fd-f8430a8d72e5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:49.794522 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c04a6b5f-cdf3-4ac9-b4fd-f8430a8d72e5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28174 microversion: 2.20 time: 0.078120 Oct 12 18:32:49.795311 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 467/929] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:49 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28174 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:32:49.817396 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a15390b7-26a4-4d2b-aa90-548c4b014d3c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:49.818477 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a15390b7-26a4-4d2b-aa90-548c4b014d3c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:49.825684 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a15390b7-26a4-4d2b-aa90-548c4b014d3c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:49.826139 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a15390b7-26a4-4d2b-aa90-548c4b014d3c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:49.826948 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a15390b7-26a4-4d2b-aa90-548c4b014d3c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:49.827363 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a15390b7-26a4-4d2b-aa90-548c4b014d3c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:49.919623 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a15390b7-26a4-4d2b-aa90-548c4b014d3c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 19342 microversion: 2.1 time: 0.105658 Oct 12 18:32:49.920248 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 463/930] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:32:49 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 19342 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:32:50.807372 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-01f84dea-bd20-4922-9fa6-a1f7a7a48de0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:50.808283 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-01f84dea-bd20-4922-9fa6-a1f7a7a48de0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:50.814956 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-01f84dea-bd20-4922-9fa6-a1f7a7a48de0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:50.815407 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-01f84dea-bd20-4922-9fa6-a1f7a7a48de0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:50.816176 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-01f84dea-bd20-4922-9fa6-a1f7a7a48de0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:50.816689 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-01f84dea-bd20-4922-9fa6-a1f7a7a48de0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:50.890320 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-01f84dea-bd20-4922-9fa6-a1f7a7a48de0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28174 microversion: 2.20 time: 0.087055 Oct 12 18:32:50.890990 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 468/931] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:50 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28174 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:32:50.931666 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-00cf3962-94d6-4ea3-bb07-9fdba40e2cc3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:50.932907 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-00cf3962-94d6-4ea3-bb07-9fdba40e2cc3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:50.939293 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-00cf3962-94d6-4ea3-bb07-9fdba40e2cc3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:50.939712 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-00cf3962-94d6-4ea3-bb07-9fdba40e2cc3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:50.940511 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-00cf3962-94d6-4ea3-bb07-9fdba40e2cc3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:50.940941 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-00cf3962-94d6-4ea3-bb07-9fdba40e2cc3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:51.033528 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-00cf3962-94d6-4ea3-bb07-9fdba40e2cc3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 21935 microversion: 2.1 time: 0.105751 Oct 12 18:32:51.034170 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 464/932] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:32:50 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 21935 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:32:51.904089 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-1d422aa9-b2a3-4b01-9db1-0f55bfb5dbff tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:51.905148 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-1d422aa9-b2a3-4b01-9db1-0f55bfb5dbff tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:51.911835 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1d422aa9-b2a3-4b01-9db1-0f55bfb5dbff tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:51.912281 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1d422aa9-b2a3-4b01-9db1-0f55bfb5dbff tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:51.913091 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1d422aa9-b2a3-4b01-9db1-0f55bfb5dbff tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:51.913522 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1d422aa9-b2a3-4b01-9db1-0f55bfb5dbff tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:51.984744 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-1d422aa9-b2a3-4b01-9db1-0f55bfb5dbff tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28174 microversion: 2.20 time: 0.085101 Oct 12 18:32:51.990403 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 469/933] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:51 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28174 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:32:52.046069 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-150cae1e-1932-492b-81ee-9283d063079b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:52.047057 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-150cae1e-1932-492b-81ee-9283d063079b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:52.053338 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-150cae1e-1932-492b-81ee-9283d063079b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:52.053785 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-150cae1e-1932-492b-81ee-9283d063079b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:52.054555 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-150cae1e-1932-492b-81ee-9283d063079b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:52.054979 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-150cae1e-1932-492b-81ee-9283d063079b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:52.135215 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-150cae1e-1932-492b-81ee-9283d063079b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 23235 microversion: 2.1 time: 0.092999 Oct 12 18:32:52.135892 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 465/934] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:32:52 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 23235 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:32:52.998806 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-f20f4dac-ab43-4a1c-9c1c-cdafc2e99071 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:52.999916 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-f20f4dac-ab43-4a1c-9c1c-cdafc2e99071 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:53.006936 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f20f4dac-ab43-4a1c-9c1c-cdafc2e99071 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:53.007373 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f20f4dac-ab43-4a1c-9c1c-cdafc2e99071 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:53.008145 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f20f4dac-ab43-4a1c-9c1c-cdafc2e99071 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:53.008614 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f20f4dac-ab43-4a1c-9c1c-cdafc2e99071 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:53.075635 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-f20f4dac-ab43-4a1c-9c1c-cdafc2e99071 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28174 microversion: 2.20 time: 0.080843 Oct 12 18:32:53.076426 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 470/935] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:52 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28174 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:32:53.147589 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8c93ad39-daf8-42d4-b4b3-f262dbf3fe12 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:53.148742 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8c93ad39-daf8-42d4-b4b3-f262dbf3fe12 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:53.155657 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8c93ad39-daf8-42d4-b4b3-f262dbf3fe12 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:53.156189 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8c93ad39-daf8-42d4-b4b3-f262dbf3fe12 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:53.157011 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8c93ad39-daf8-42d4-b4b3-f262dbf3fe12 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:53.157441 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8c93ad39-daf8-42d4-b4b3-f262dbf3fe12 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:53.234844 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8c93ad39-daf8-42d4-b4b3-f262dbf3fe12 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 24719 microversion: 2.1 time: 0.091118 Oct 12 18:32:53.235217 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 466/936] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:32:53 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 24719 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:32:54.088599 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-69444a65-ec0e-4186-9323-489e2b929cd0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:54.089531 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-69444a65-ec0e-4186-9323-489e2b929cd0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:54.096014 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-69444a65-ec0e-4186-9323-489e2b929cd0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:54.096482 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-69444a65-ec0e-4186-9323-489e2b929cd0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:54.097246 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-69444a65-ec0e-4186-9323-489e2b929cd0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:54.097671 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-69444a65-ec0e-4186-9323-489e2b929cd0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:54.168766 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-69444a65-ec0e-4186-9323-489e2b929cd0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28174 microversion: 2.20 time: 0.084909 Oct 12 18:32:54.169671 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 471/937] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:54 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28174 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:32:54.247435 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-51a53604-89ec-4b1e-8944-1e5c19d7a096 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:54.248442 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-51a53604-89ec-4b1e-8944-1e5c19d7a096 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:54.255032 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-51a53604-89ec-4b1e-8944-1e5c19d7a096 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:54.255477 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-51a53604-89ec-4b1e-8944-1e5c19d7a096 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:54.256260 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-51a53604-89ec-4b1e-8944-1e5c19d7a096 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:54.256724 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-51a53604-89ec-4b1e-8944-1e5c19d7a096 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:54.342648 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-51a53604-89ec-4b1e-8944-1e5c19d7a096 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 26104 microversion: 2.1 time: 0.099228 Oct 12 18:32:54.343127 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 467/938] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:32:54 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 26104 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:32:55.181306 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-2be47fd0-57ec-4a04-bce5-f7ab9bdd97b1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:55.182305 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-2be47fd0-57ec-4a04-bce5-f7ab9bdd97b1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:55.188733 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2be47fd0-57ec-4a04-bce5-f7ab9bdd97b1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:55.189175 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2be47fd0-57ec-4a04-bce5-f7ab9bdd97b1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:55.189934 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2be47fd0-57ec-4a04-bce5-f7ab9bdd97b1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:55.190353 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2be47fd0-57ec-4a04-bce5-f7ab9bdd97b1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:55.266170 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-2be47fd0-57ec-4a04-bce5-f7ab9bdd97b1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28174 microversion: 2.20 time: 0.088691 Oct 12 18:32:55.266810 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 472/939] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:55 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28174 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:32:55.354556 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-213a44e5-ef17-40c3-b8da-365757493643 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:55.355668 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-213a44e5-ef17-40c3-b8da-365757493643 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:55.362200 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-213a44e5-ef17-40c3-b8da-365757493643 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:55.362690 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-213a44e5-ef17-40c3-b8da-365757493643 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:55.363494 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-213a44e5-ef17-40c3-b8da-365757493643 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:55.363846 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-213a44e5-ef17-40c3-b8da-365757493643 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:55.451539 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-213a44e5-ef17-40c3-b8da-365757493643 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 27026 microversion: 2.1 time: 0.101335 Oct 12 18:32:55.452101 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 468/940] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:32:55 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 27026 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:32:56.279006 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-97b8f241-6554-4458-9dda-79159c879963 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:56.280002 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-97b8f241-6554-4458-9dda-79159c879963 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:56.286532 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-97b8f241-6554-4458-9dda-79159c879963 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:56.287003 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-97b8f241-6554-4458-9dda-79159c879963 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:56.287785 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-97b8f241-6554-4458-9dda-79159c879963 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:56.288213 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-97b8f241-6554-4458-9dda-79159c879963 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:56.356786 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-97b8f241-6554-4458-9dda-79159c879963 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28174 microversion: 2.20 time: 0.082157 Oct 12 18:32:56.357463 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 473/941] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:56 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28174 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:32:56.463759 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ba6e47e6-c726-4127-8d2c-e442a346a613 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:56.464785 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ba6e47e6-c726-4127-8d2c-e442a346a613 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:56.471309 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ba6e47e6-c726-4127-8d2c-e442a346a613 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:56.471764 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ba6e47e6-c726-4127-8d2c-e442a346a613 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:56.472575 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ba6e47e6-c726-4127-8d2c-e442a346a613 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:56.473008 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ba6e47e6-c726-4127-8d2c-e442a346a613 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:56.535911 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-4a689c21-4cbc-43e4-9d15-1990b832339d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1407477470", "imageRef": "c79f0511-74c5-46f3-a7e6-cde6b09234ee", "flavorRef": "452", "networks": [{"uuid": "2e0b2b7e-810d-4085-a3e3-d8a60d0397cb"}]}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:56.561767 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ba6e47e6-c726-4127-8d2c-e442a346a613 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 27469 microversion: 2.1 time: 0.102008 Oct 12 18:32:56.562414 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 469/942] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:32:56 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 27469 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:32:56.589518 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.network.neutron [None req-4a689c21-4cbc-43e4-9d15-1990b832339d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] validate_networks() for [('2e0b2b7e-810d-4085-a3e3-d8a60d0397cb', None, None, None, None, None)] {{(pid=109169) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 18:32:56.941310 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-4a689c21-4cbc-43e4-9d15-1990b832339d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Flavor limits 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 18:32:56.941783 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-4a689c21-4cbc-43e4-9d15-1990b832339d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Image limits 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 18:32:56.942252 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-4a689c21-4cbc-43e4-9d15-1990b832339d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Flavor pref 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 18:32:56.942657 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-4a689c21-4cbc-43e4-9d15-1990b832339d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Image pref 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 18:32:56.943210 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-4a689c21-4cbc-43e4-9d15-1990b832339d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 18:32:56.952184 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4a689c21-4cbc-43e4-9d15-1990b832339d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:56.952656 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4a689c21-4cbc-43e4-9d15-1990b832339d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:56.953456 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4a689c21-4cbc-43e4-9d15-1990b832339d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:56.953894 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4a689c21-4cbc-43e4-9d15-1990b832339d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:56.970625 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.quota [None req-4a689c21-4cbc-43e4-9d15-1990b832339d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Getting quotas for project 4ec087a3edc444cbb249442bb987326c. Resources: {'instances', 'cores', 'ram'} {{(pid=109169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:32:56.974525 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.quota [None req-4a689c21-4cbc-43e4-9d15-1990b832339d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Getting quotas for user eaaa8dff1ca444f081caa0cd1b4be6a9 and project 4ec087a3edc444cbb249442bb987326c. Resources: {'instances', 'cores', 'ram'} {{(pid=109169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:32:56.987669 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-4a689c21-4cbc-43e4-9d15-1990b832339d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Going to run 1 instances... {{(pid=109169) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 18:32:56.990145 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-4a689c21-4cbc-43e4-9d15-1990b832339d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: c507ce79-0fb1-47d8-b6bf-9992f9d9484a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c79f0511-74c5-46f3-a7e6-cde6b09234ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109169) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 18:32:57.126318 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-4a689c21-4cbc-43e4-9d15-1990b832339d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594460 Oct 12 18:32:57.126873 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 474/943] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Oct 12 18:32:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 18:32:57.137993 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-18c4e455-0bc4-418a-a417-fb509790b816 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:57.138722 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-18c4e455-0bc4-418a-a417-fb509790b816 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: c507ce79-0fb1-47d8-b6bf-9992f9d9484a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:57.195893 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-18c4e455-0bc4-418a-a417-fb509790b816 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:57.203262 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-18c4e455-0bc4-418a-a417-fb509790b816 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a" status: 200 len: 1219 microversion: 2.1 time: 0.069991 Oct 12 18:32:57.203844 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 470/944] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:57 2021] GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:32:57.368529 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-5c81b3b3-83f6-4656-a6dd-7118cfd52aac tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:57.372069 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-5c81b3b3-83f6-4656-a6dd-7118cfd52aac tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:57.375893 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5c81b3b3-83f6-4656-a6dd-7118cfd52aac tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:57.376496 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5c81b3b3-83f6-4656-a6dd-7118cfd52aac tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:57.377174 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5c81b3b3-83f6-4656-a6dd-7118cfd52aac tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:57.377599 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5c81b3b3-83f6-4656-a6dd-7118cfd52aac tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:57.444122 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-5c81b3b3-83f6-4656-a6dd-7118cfd52aac tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28174 microversion: 2.20 time: 0.079018 Oct 12 18:32:57.449597 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 475/945] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:57 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28174 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:32:57.573959 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-47485d63-c9ad-4efd-b29b-2fa478546665 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:57.574881 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-47485d63-c9ad-4efd-b29b-2fa478546665 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:57.581678 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-47485d63-c9ad-4efd-b29b-2fa478546665 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:57.582122 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-47485d63-c9ad-4efd-b29b-2fa478546665 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:57.582892 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-47485d63-c9ad-4efd-b29b-2fa478546665 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:57.583319 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-47485d63-c9ad-4efd-b29b-2fa478546665 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:57.669605 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-47485d63-c9ad-4efd-b29b-2fa478546665 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 27790 microversion: 2.1 time: 0.099119 Oct 12 18:32:57.670289 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 471/946] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:32:57 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 27790 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:32:58.225874 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-fd08b6c0-c8bd-4127-acb6-f85dbefa1c9d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:58.226539 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-fd08b6c0-c8bd-4127-acb6-f85dbefa1c9d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: c507ce79-0fb1-47d8-b6bf-9992f9d9484a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:58.282925 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-fd08b6c0-c8bd-4127-acb6-f85dbefa1c9d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:58.289342 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-fd08b6c0-c8bd-4127-acb6-f85dbefa1c9d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a" status: 200 len: 1219 microversion: 2.1 time: 0.067424 Oct 12 18:32:58.289895 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 476/947] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:58 2021] GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:58.459947 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c8e24a3b-a7b8-4e93-be71-a3d283034791 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:58.460977 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c8e24a3b-a7b8-4e93-be71-a3d283034791 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:58.467775 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c8e24a3b-a7b8-4e93-be71-a3d283034791 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:58.468219 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c8e24a3b-a7b8-4e93-be71-a3d283034791 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:58.469028 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c8e24a3b-a7b8-4e93-be71-a3d283034791 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:58.469448 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c8e24a3b-a7b8-4e93-be71-a3d283034791 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:58.535226 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c8e24a3b-a7b8-4e93-be71-a3d283034791 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28174 microversion: 2.20 time: 0.079526 Oct 12 18:32:58.535807 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 472/948] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:58 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28174 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:32:58.682234 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-b877909c-44d3-4b32-a989-3bc3d1607c5f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:58.682932 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-b877909c-44d3-4b32-a989-3bc3d1607c5f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:58.689961 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b877909c-44d3-4b32-a989-3bc3d1607c5f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:58.690400 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b877909c-44d3-4b32-a989-3bc3d1607c5f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:58.691174 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b877909c-44d3-4b32-a989-3bc3d1607c5f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:58.691605 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b877909c-44d3-4b32-a989-3bc3d1607c5f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:58.771580 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-b877909c-44d3-4b32-a989-3bc3d1607c5f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 27898 microversion: 2.1 time: 0.093444 Oct 12 18:32:58.772222 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 477/949] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:32:58 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 27898 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:32:59.307117 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-aa70abf7-037e-4efe-b949-f7a74ed63ae9 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:32:59.307846 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-aa70abf7-037e-4efe-b949-f7a74ed63ae9 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: c507ce79-0fb1-47d8-b6bf-9992f9d9484a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:59.314468 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-aa70abf7-037e-4efe-b949-f7a74ed63ae9 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:59.314908 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-aa70abf7-037e-4efe-b949-f7a74ed63ae9 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:59.315684 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-aa70abf7-037e-4efe-b949-f7a74ed63ae9 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:59.316114 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-aa70abf7-037e-4efe-b949-f7a74ed63ae9 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:59.376653 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-aa70abf7-037e-4efe-b949-f7a74ed63ae9 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:32:59.384532 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-aa70abf7-037e-4efe-b949-f7a74ed63ae9 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a" status: 200 len: 1271 microversion: 2.1 time: 0.080851 Oct 12 18:32:59.385098 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 473/950] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:32:59 2021] GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:32:59.547787 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-1a55b9a4-1890-41d5-ad82-7f97e58e6442 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:59.548839 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-1a55b9a4-1890-41d5-ad82-7f97e58e6442 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:59.555464 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1a55b9a4-1890-41d5-ad82-7f97e58e6442 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:59.562076 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1a55b9a4-1890-41d5-ad82-7f97e58e6442 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:59.562076 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1a55b9a4-1890-41d5-ad82-7f97e58e6442 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:59.562076 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1a55b9a4-1890-41d5-ad82-7f97e58e6442 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:59.649138 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-1a55b9a4-1890-41d5-ad82-7f97e58e6442 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28174 microversion: 2.20 time: 0.105116 Oct 12 18:32:59.650377 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 478/951] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:32:59 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28174 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:32:59.784060 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-34fd6ac7-29b0-4537-88ce-5d336783ba5b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:32:59.784988 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-34fd6ac7-29b0-4537-88ce-5d336783ba5b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:32:59.790945 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-34fd6ac7-29b0-4537-88ce-5d336783ba5b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:59.791390 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-34fd6ac7-29b0-4537-88ce-5d336783ba5b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:59.792178 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-34fd6ac7-29b0-4537-88ce-5d336783ba5b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:32:59.792641 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-34fd6ac7-29b0-4537-88ce-5d336783ba5b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:32:59.890240 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-34fd6ac7-29b0-4537-88ce-5d336783ba5b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28077 microversion: 2.1 time: 0.109637 Oct 12 18:32:59.891139 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 474/952] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:32:59 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28077 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:33:00.403053 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-3b504c93-911c-45cf-949f-4b809b0f7973 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:33:00.404005 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-3b504c93-911c-45cf-949f-4b809b0f7973 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: c507ce79-0fb1-47d8-b6bf-9992f9d9484a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:00.412658 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3b504c93-911c-45cf-949f-4b809b0f7973 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:00.413098 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3b504c93-911c-45cf-949f-4b809b0f7973 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:00.413860 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3b504c93-911c-45cf-949f-4b809b0f7973 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:00.414289 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3b504c93-911c-45cf-949f-4b809b0f7973 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:00.662961 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-17d64c19-b083-48ad-87ca-c6156d2afc64 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:00.664156 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-17d64c19-b083-48ad-87ca-c6156d2afc64 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:00.672182 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-17d64c19-b083-48ad-87ca-c6156d2afc64 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:00.672743 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-17d64c19-b083-48ad-87ca-c6156d2afc64 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:00.673835 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-17d64c19-b083-48ad-87ca-c6156d2afc64 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:00.674357 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-17d64c19-b083-48ad-87ca-c6156d2afc64 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:00.751065 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-17d64c19-b083-48ad-87ca-c6156d2afc64 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28174 microversion: 2.20 time: 0.092652 Oct 12 18:33:00.751736 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 475/953] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:00 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28174 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:33:00.900383 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-3b504c93-911c-45cf-949f-4b809b0f7973 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:33:00.902311 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-736f9505-3e5a-4a3c-adc4-d5b84cf3355b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:00.903312 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-736f9505-3e5a-4a3c-adc4-d5b84cf3355b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:00.908182 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-3b504c93-911c-45cf-949f-4b809b0f7973 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a" status: 200 len: 1319 microversion: 2.1 time: 0.509633 Oct 12 18:33:00.909977 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 479/954] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:33:00 2021] GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a => generated 1319 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:33:00.910858 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-736f9505-3e5a-4a3c-adc4-d5b84cf3355b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:00.911312 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-736f9505-3e5a-4a3c-adc4-d5b84cf3355b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:00.912138 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-736f9505-3e5a-4a3c-adc4-d5b84cf3355b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:00.912605 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-736f9505-3e5a-4a3c-adc4-d5b84cf3355b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:00.987171 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-736f9505-3e5a-4a3c-adc4-d5b84cf3355b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28194 microversion: 2.1 time: 0.089304 Oct 12 18:33:00.991219 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 476/955] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:00 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28194 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:33:01.393774 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-5b886a23-df10-453d-91da-bc82f0ac96a9 req-effb0b6b-fda2-4024-8dbe-0008eddc92a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c507ce79-0fb1-47d8-b6bf-9992f9d9484a", "tag": "2efc30ec-72a3-444c-a8d7-f07a6846d636"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:01.395651 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:33:01.395651 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:33:01.403011 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-5b886a23-df10-453d-91da-bc82f0ac96a9 req-effb0b6b-fda2-4024-8dbe-0008eddc92a2 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:01.403455 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-5b886a23-df10-453d-91da-bc82f0ac96a9 req-effb0b6b-fda2-4024-8dbe-0008eddc92a2 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:01.416236 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-5b886a23-df10-453d-91da-bc82f0ac96a9 req-effb0b6b-fda2-4024-8dbe-0008eddc92a2 service nova] Creating event network-changed:2efc30ec-72a3-444c-a8d7-f07a6846d636 for instance c507ce79-0fb1-47d8-b6bf-9992f9d9484a on hv-cinder-81322 Oct 12 18:33:01.421724 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-5b886a23-df10-453d-91da-bc82f0ac96a9 req-effb0b6b-fda2-4024-8dbe-0008eddc92a2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031472 Oct 12 18:33:01.422275 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 480/956] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:33:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:33:01.763554 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e46fdc72-407e-4c3b-b080-81b94f8866e6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:01.764568 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e46fdc72-407e-4c3b-b080-81b94f8866e6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:01.771151 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e46fdc72-407e-4c3b-b080-81b94f8866e6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:01.771602 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e46fdc72-407e-4c3b-b080-81b94f8866e6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:01.772388 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e46fdc72-407e-4c3b-b080-81b94f8866e6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:01.772955 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e46fdc72-407e-4c3b-b080-81b94f8866e6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:01.855982 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e46fdc72-407e-4c3b-b080-81b94f8866e6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28465 microversion: 2.20 time: 0.096247 Oct 12 18:33:01.859552 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 477/957] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:01 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28465 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:01.925828 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-096d4cc9-33c5-49d6-9c14-652139be9bcb tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:33:01.926524 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-096d4cc9-33c5-49d6-9c14-652139be9bcb tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: c507ce79-0fb1-47d8-b6bf-9992f9d9484a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:01.933175 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-096d4cc9-33c5-49d6-9c14-652139be9bcb tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:01.933611 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-096d4cc9-33c5-49d6-9c14-652139be9bcb tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:01.934366 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-096d4cc9-33c5-49d6-9c14-652139be9bcb tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:01.934791 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-096d4cc9-33c5-49d6-9c14-652139be9bcb tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:01.999746 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-50550a69-2034-4110-8882-5a93400ed661 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:02.000776 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-50550a69-2034-4110-8882-5a93400ed661 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:02.007231 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-50550a69-2034-4110-8882-5a93400ed661 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:02.007683 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-50550a69-2034-4110-8882-5a93400ed661 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:02.008493 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-50550a69-2034-4110-8882-5a93400ed661 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:02.009696 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-50550a69-2034-4110-8882-5a93400ed661 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:02.076988 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-50550a69-2034-4110-8882-5a93400ed661 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28194 microversion: 2.1 time: 0.081189 Oct 12 18:33:02.080830 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 478/958] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:01 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28194 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:33:02.154030 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-096d4cc9-33c5-49d6-9c14-652139be9bcb tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:33:02.161218 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-096d4cc9-33c5-49d6-9c14-652139be9bcb tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a" status: 200 len: 1319 microversion: 2.1 time: 0.239448 Oct 12 18:33:02.161792 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 481/959] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:33:01 2021] GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:33:02.867658 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b8826389-bcc5-493f-a844-3dda7b6345a8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:02.868614 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b8826389-bcc5-493f-a844-3dda7b6345a8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:02.875012 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b8826389-bcc5-493f-a844-3dda7b6345a8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:02.875459 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b8826389-bcc5-493f-a844-3dda7b6345a8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:02.876229 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b8826389-bcc5-493f-a844-3dda7b6345a8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:02.876708 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b8826389-bcc5-493f-a844-3dda7b6345a8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:03.030277 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b8826389-bcc5-493f-a844-3dda7b6345a8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28465 microversion: 2.20 time: 0.166557 Oct 12 18:33:03.031235 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 479/960] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:02 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28465 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:03.088380 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-f24812c9-df4a-4ee8-a603-e4ca499e245e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:03.089319 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-f24812c9-df4a-4ee8-a603-e4ca499e245e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:03.095061 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f24812c9-df4a-4ee8-a603-e4ca499e245e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:03.095498 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f24812c9-df4a-4ee8-a603-e4ca499e245e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:03.096247 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f24812c9-df4a-4ee8-a603-e4ca499e245e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:03.096703 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f24812c9-df4a-4ee8-a603-e4ca499e245e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:03.161658 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-f24812c9-df4a-4ee8-a603-e4ca499e245e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28194 microversion: 2.1 time: 0.076749 Oct 12 18:33:03.162166 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 482/961] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:03 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28194 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:33:03.178700 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e96d9ba4-29d4-4f24-8550-29ea243e124d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:33:03.179398 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e96d9ba4-29d4-4f24-8550-29ea243e124d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: c507ce79-0fb1-47d8-b6bf-9992f9d9484a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:03.186368 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e96d9ba4-29d4-4f24-8550-29ea243e124d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:03.186812 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e96d9ba4-29d4-4f24-8550-29ea243e124d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:03.187571 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e96d9ba4-29d4-4f24-8550-29ea243e124d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:03.187999 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e96d9ba4-29d4-4f24-8550-29ea243e124d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:03.314016 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e96d9ba4-29d4-4f24-8550-29ea243e124d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:33:03.321133 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e96d9ba4-29d4-4f24-8550-29ea243e124d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a" status: 200 len: 1319 microversion: 2.1 time: 0.146286 Oct 12 18:33:03.322259 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 480/962] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:33:03 2021] GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:33:04.043002 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-298ee372-1f41-49d3-a5bb-b05cce6844be tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:04.043996 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-298ee372-1f41-49d3-a5bb-b05cce6844be tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:04.050416 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-298ee372-1f41-49d3-a5bb-b05cce6844be tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:04.050859 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-298ee372-1f41-49d3-a5bb-b05cce6844be tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:04.051622 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-298ee372-1f41-49d3-a5bb-b05cce6844be tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:04.052048 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-298ee372-1f41-49d3-a5bb-b05cce6844be tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:04.130581 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-298ee372-1f41-49d3-a5bb-b05cce6844be tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.091971 Oct 12 18:33:04.131248 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 483/963] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:04 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:04.173492 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-61ee5b3d-1a71-4735-9e05-ff7888dd6c44 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:04.174480 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-61ee5b3d-1a71-4735-9e05-ff7888dd6c44 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:04.180536 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-61ee5b3d-1a71-4735-9e05-ff7888dd6c44 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:04.180986 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-61ee5b3d-1a71-4735-9e05-ff7888dd6c44 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:04.181748 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-61ee5b3d-1a71-4735-9e05-ff7888dd6c44 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:04.182178 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-61ee5b3d-1a71-4735-9e05-ff7888dd6c44 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:04.253957 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-61ee5b3d-1a71-4735-9e05-ff7888dd6c44 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28194 microversion: 2.1 time: 0.083893 Oct 12 18:33:04.254915 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 481/964] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:04 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28194 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:33:04.343765 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-de124f73-6d8e-47a0-b330-306d50f156ee tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:33:04.345018 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-de124f73-6d8e-47a0-b330-306d50f156ee tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: c507ce79-0fb1-47d8-b6bf-9992f9d9484a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:04.356340 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-de124f73-6d8e-47a0-b330-306d50f156ee tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:04.357132 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-de124f73-6d8e-47a0-b330-306d50f156ee tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:04.358431 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-de124f73-6d8e-47a0-b330-306d50f156ee tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:04.359179 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-de124f73-6d8e-47a0-b330-306d50f156ee tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:04.485038 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-de124f73-6d8e-47a0-b330-306d50f156ee tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:33:04.493253 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-de124f73-6d8e-47a0-b330-306d50f156ee tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a" status: 200 len: 1319 microversion: 2.1 time: 0.156835 Oct 12 18:33:04.493946 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 484/965] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:33:04 2021] GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:33:05.143357 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-31553c78-3bc8-4182-a513-38a8a9e695f6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:05.144343 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-31553c78-3bc8-4182-a513-38a8a9e695f6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:05.151316 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-31553c78-3bc8-4182-a513-38a8a9e695f6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:05.151747 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-31553c78-3bc8-4182-a513-38a8a9e695f6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:05.152532 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-31553c78-3bc8-4182-a513-38a8a9e695f6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:05.152958 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-31553c78-3bc8-4182-a513-38a8a9e695f6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:05.220374 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-31553c78-3bc8-4182-a513-38a8a9e695f6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.080781 Oct 12 18:33:05.221091 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 482/966] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:05 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:05.265098 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-6fed3d07-6fad-4e58-b807-c316ab4c2345 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:05.266023 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-6fed3d07-6fad-4e58-b807-c316ab4c2345 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:05.271853 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6fed3d07-6fad-4e58-b807-c316ab4c2345 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:05.272283 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6fed3d07-6fad-4e58-b807-c316ab4c2345 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:05.273085 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6fed3d07-6fad-4e58-b807-c316ab4c2345 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:05.273510 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6fed3d07-6fad-4e58-b807-c316ab4c2345 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:05.339534 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-6fed3d07-6fad-4e58-b807-c316ab4c2345 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28194 microversion: 2.1 time: 0.077811 Oct 12 18:33:05.340174 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 485/967] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:05 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28194 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:33:05.511016 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-458bd052-3813-4242-874e-6d02825dbbff tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:33:05.511707 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-458bd052-3813-4242-874e-6d02825dbbff tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: c507ce79-0fb1-47d8-b6bf-9992f9d9484a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:05.518767 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-458bd052-3813-4242-874e-6d02825dbbff tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:05.519114 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-458bd052-3813-4242-874e-6d02825dbbff tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:05.519891 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-458bd052-3813-4242-874e-6d02825dbbff tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:05.520321 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-458bd052-3813-4242-874e-6d02825dbbff tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:05.645114 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-458bd052-3813-4242-874e-6d02825dbbff tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:33:05.653391 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-458bd052-3813-4242-874e-6d02825dbbff tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a" status: 200 len: 1319 microversion: 2.1 time: 0.146375 Oct 12 18:33:05.654206 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 483/968] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:33:05 2021] GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:33:06.232728 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-b2b4342c-28a1-4e00-816b-30b4ed9e9376 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:06.233722 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-b2b4342c-28a1-4e00-816b-30b4ed9e9376 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:06.240083 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b2b4342c-28a1-4e00-816b-30b4ed9e9376 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:06.240565 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b2b4342c-28a1-4e00-816b-30b4ed9e9376 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:06.241340 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b2b4342c-28a1-4e00-816b-30b4ed9e9376 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:06.241771 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b2b4342c-28a1-4e00-816b-30b4ed9e9376 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:06.342259 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-b2b4342c-28a1-4e00-816b-30b4ed9e9376 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.113433 Oct 12 18:33:06.342916 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 486/969] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:06 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:06.351395 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c5ab6f65-8a2f-4b38-bb5d-ddd148d4030c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:06.352772 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c5ab6f65-8a2f-4b38-bb5d-ddd148d4030c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:06.363192 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c5ab6f65-8a2f-4b38-bb5d-ddd148d4030c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:06.364255 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c5ab6f65-8a2f-4b38-bb5d-ddd148d4030c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:06.365377 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c5ab6f65-8a2f-4b38-bb5d-ddd148d4030c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:06.365878 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c5ab6f65-8a2f-4b38-bb5d-ddd148d4030c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:06.437270 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c5ab6f65-8a2f-4b38-bb5d-ddd148d4030c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28194 microversion: 2.1 time: 0.089624 Oct 12 18:33:06.438961 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 484/970] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:06 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28194 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:33:06.671476 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-2763d2ae-c28c-4241-936a-bd2bcb511d27 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:33:06.672166 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-2763d2ae-c28c-4241-936a-bd2bcb511d27 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: c507ce79-0fb1-47d8-b6bf-9992f9d9484a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:06.678629 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2763d2ae-c28c-4241-936a-bd2bcb511d27 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:06.679101 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2763d2ae-c28c-4241-936a-bd2bcb511d27 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:06.679866 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2763d2ae-c28c-4241-936a-bd2bcb511d27 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:06.680292 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2763d2ae-c28c-4241-936a-bd2bcb511d27 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:06.799594 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-2763d2ae-c28c-4241-936a-bd2bcb511d27 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:33:06.807500 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-2763d2ae-c28c-4241-936a-bd2bcb511d27 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a" status: 200 len: 1319 microversion: 2.1 time: 0.140071 Oct 12 18:33:06.808064 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 487/971] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:33:06 2021] GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a => generated 1319 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:33:07.355425 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c73c753e-de21-4a2e-a872-575ee75cb5e3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:07.356426 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c73c753e-de21-4a2e-a872-575ee75cb5e3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:07.362790 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c73c753e-de21-4a2e-a872-575ee75cb5e3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:07.363229 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c73c753e-de21-4a2e-a872-575ee75cb5e3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:07.363986 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c73c753e-de21-4a2e-a872-575ee75cb5e3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:07.364443 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c73c753e-de21-4a2e-a872-575ee75cb5e3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:07.424171 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c73c753e-de21-4a2e-a872-575ee75cb5e3 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.073209 Oct 12 18:33:07.424935 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 485/972] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:07 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:07.449230 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-b49b43a4-ac13-4811-888f-106b5ded6273 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:07.450132 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-b49b43a4-ac13-4811-888f-106b5ded6273 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:07.455954 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b49b43a4-ac13-4811-888f-106b5ded6273 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:07.456388 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b49b43a4-ac13-4811-888f-106b5ded6273 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:07.457164 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b49b43a4-ac13-4811-888f-106b5ded6273 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:07.457586 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b49b43a4-ac13-4811-888f-106b5ded6273 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:07.526944 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-b49b43a4-ac13-4811-888f-106b5ded6273 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28194 microversion: 2.1 time: 0.081681 Oct 12 18:33:07.527572 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 488/973] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:07 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28194 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:33:07.824890 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2fee898c-5f2c-46ce-94c2-38c87410c9a2 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:33:07.825641 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2fee898c-5f2c-46ce-94c2-38c87410c9a2 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: c507ce79-0fb1-47d8-b6bf-9992f9d9484a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:07.831980 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2fee898c-5f2c-46ce-94c2-38c87410c9a2 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:07.832836 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2fee898c-5f2c-46ce-94c2-38c87410c9a2 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:07.833322 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2fee898c-5f2c-46ce-94c2-38c87410c9a2 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:07.833757 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2fee898c-5f2c-46ce-94c2-38c87410c9a2 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:07.917938 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-7fe621b4-1365-4840-95c2-cec756674e92 req-5caf6cb3-e397-44fa-83f7-29c3b643bcbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c507ce79-0fb1-47d8-b6bf-9992f9d9484a", "name": "network-vif-plugged", "status": "completed", "tag": "2efc30ec-72a3-444c-a8d7-f07a6846d636"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:07.920300 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:33:07.920300 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:33:07.928834 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-7fe621b4-1365-4840-95c2-cec756674e92 req-5caf6cb3-e397-44fa-83f7-29c3b643bcbb service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:07.929374 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-7fe621b4-1365-4840-95c2-cec756674e92 req-5caf6cb3-e397-44fa-83f7-29c3b643bcbb service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:07.941870 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-7fe621b4-1365-4840-95c2-cec756674e92 req-5caf6cb3-e397-44fa-83f7-29c3b643bcbb service nova] Creating event network-vif-plugged:2efc30ec-72a3-444c-a8d7-f07a6846d636 for instance c507ce79-0fb1-47d8-b6bf-9992f9d9484a on hv-cinder-81322 Oct 12 18:33:07.947691 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-7fe621b4-1365-4840-95c2-cec756674e92 req-5caf6cb3-e397-44fa-83f7-29c3b643bcbb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034609 Oct 12 18:33:07.948496 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 489/974] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:33:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 18:33:07.968311 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2fee898c-5f2c-46ce-94c2-38c87410c9a2 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:33:07.976380 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2fee898c-5f2c-46ce-94c2-38c87410c9a2 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a" status: 200 len: 1319 microversion: 2.1 time: 0.155700 Oct 12 18:33:07.976993 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 486/975] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:33:07 2021] GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:33:08.436228 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-93a43abd-7847-46de-b275-1c4cf77be611 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:08.438579 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-93a43abd-7847-46de-b275-1c4cf77be611 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:08.443335 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-93a43abd-7847-46de-b275-1c4cf77be611 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:08.443772 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-93a43abd-7847-46de-b275-1c4cf77be611 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:08.444565 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-93a43abd-7847-46de-b275-1c4cf77be611 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:08.445012 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-93a43abd-7847-46de-b275-1c4cf77be611 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:08.538769 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a7704e2c-10b3-4b80-9f73-7c8dd3350e76 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:08.539674 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a7704e2c-10b3-4b80-9f73-7c8dd3350e76 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:08.546041 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a7704e2c-10b3-4b80-9f73-7c8dd3350e76 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:08.546484 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a7704e2c-10b3-4b80-9f73-7c8dd3350e76 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:08.547244 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a7704e2c-10b3-4b80-9f73-7c8dd3350e76 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:08.547679 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a7704e2c-10b3-4b80-9f73-7c8dd3350e76 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:08.748450 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a7704e2c-10b3-4b80-9f73-7c8dd3350e76 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28194 microversion: 2.1 time: 0.213137 Oct 12 18:33:08.749387 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 487/976] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:08 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28194 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:33:08.752199 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-93a43abd-7847-46de-b275-1c4cf77be611 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.319818 Oct 12 18:33:08.753255 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 490/977] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:08 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:08.994227 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-082b633a-4c1b-491d-97d1-25d23119379e tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:33:08.994841 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-082b633a-4c1b-491d-97d1-25d23119379e tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: c507ce79-0fb1-47d8-b6bf-9992f9d9484a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:09.001248 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-082b633a-4c1b-491d-97d1-25d23119379e tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:09.001700 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-082b633a-4c1b-491d-97d1-25d23119379e tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:09.002464 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-082b633a-4c1b-491d-97d1-25d23119379e tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:09.002900 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-082b633a-4c1b-491d-97d1-25d23119379e tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:09.124352 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-082b633a-4c1b-491d-97d1-25d23119379e tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:33:09.131715 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-082b633a-4c1b-491d-97d1-25d23119379e tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a" status: 200 len: 1319 microversion: 2.1 time: 0.141475 Oct 12 18:33:09.132278 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 488/978] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:33:08 2021] GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a => generated 1319 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:33:09.761326 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-41f65810-06e8-4e4a-82bc-7f84f9077e6d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:09.762337 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-41f65810-06e8-4e4a-82bc-7f84f9077e6d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:09.763990 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f2a0eca5-eb44-43a1-a5ab-a40ce3bfbf7f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:09.764955 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f2a0eca5-eb44-43a1-a5ab-a40ce3bfbf7f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:09.769085 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-41f65810-06e8-4e4a-82bc-7f84f9077e6d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:09.769535 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-41f65810-06e8-4e4a-82bc-7f84f9077e6d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:09.770308 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-41f65810-06e8-4e4a-82bc-7f84f9077e6d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:09.770743 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-41f65810-06e8-4e4a-82bc-7f84f9077e6d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:09.770904 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f2a0eca5-eb44-43a1-a5ab-a40ce3bfbf7f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:09.771510 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f2a0eca5-eb44-43a1-a5ab-a40ce3bfbf7f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:09.772307 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f2a0eca5-eb44-43a1-a5ab-a40ce3bfbf7f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:09.772912 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f2a0eca5-eb44-43a1-a5ab-a40ce3bfbf7f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:09.844387 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f2a0eca5-eb44-43a1-a5ab-a40ce3bfbf7f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.085042 Oct 12 18:33:09.845058 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 489/979] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:09 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:33:09.863420 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-41f65810-06e8-4e4a-82bc-7f84f9077e6d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28194 microversion: 2.1 time: 0.106009 Oct 12 18:33:09.873248 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 491/980] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:09 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28194 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:33:10.149782 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-57b08275-cd8f-423e-998a-eee28c662f2d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:33:10.150398 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-57b08275-cd8f-423e-998a-eee28c662f2d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: c507ce79-0fb1-47d8-b6bf-9992f9d9484a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:10.158245 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-57b08275-cd8f-423e-998a-eee28c662f2d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:10.158719 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-57b08275-cd8f-423e-998a-eee28c662f2d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:10.159492 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-57b08275-cd8f-423e-998a-eee28c662f2d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:10.159920 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-57b08275-cd8f-423e-998a-eee28c662f2d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:10.288884 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-57b08275-cd8f-423e-998a-eee28c662f2d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:33:10.296154 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-57b08275-cd8f-423e-998a-eee28c662f2d tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a" status: 200 len: 1507 microversion: 2.1 time: 0.150740 Oct 12 18:33:10.296792 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 490/981] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:33:10 2021] GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:33:10.857231 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-db06ba2a-9beb-49f6-89f0-b4e2d9ec69ca tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:10.858236 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-db06ba2a-9beb-49f6-89f0-b4e2d9ec69ca tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:10.865386 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-db06ba2a-9beb-49f6-89f0-b4e2d9ec69ca tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:10.865838 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-db06ba2a-9beb-49f6-89f0-b4e2d9ec69ca tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:10.866619 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-db06ba2a-9beb-49f6-89f0-b4e2d9ec69ca tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:10.867054 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-db06ba2a-9beb-49f6-89f0-b4e2d9ec69ca tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:10.885420 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1bb124ee-ce6d-458b-a662-37b9a1308a67 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:10.885420 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1bb124ee-ce6d-458b-a662-37b9a1308a67 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:10.887994 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1bb124ee-ce6d-458b-a662-37b9a1308a67 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:10.888543 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1bb124ee-ce6d-458b-a662-37b9a1308a67 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:10.889393 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1bb124ee-ce6d-458b-a662-37b9a1308a67 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:10.889906 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1bb124ee-ce6d-458b-a662-37b9a1308a67 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:10.937511 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-db06ba2a-9beb-49f6-89f0-b4e2d9ec69ca tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.084804 Oct 12 18:33:10.941874 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 492/982] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:10 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:10.959700 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1bb124ee-ce6d-458b-a662-37b9a1308a67 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28194 microversion: 2.1 time: 0.082422 Oct 12 18:33:10.963746 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 491/983] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:10 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28194 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:33:11.950487 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-5070d4d7-38d9-43e3-b1fd-668d77c656f7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:11.951751 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-5070d4d7-38d9-43e3-b1fd-668d77c656f7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:11.958663 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5070d4d7-38d9-43e3-b1fd-668d77c656f7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:11.959130 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5070d4d7-38d9-43e3-b1fd-668d77c656f7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:11.959910 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5070d4d7-38d9-43e3-b1fd-668d77c656f7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:11.960335 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5070d4d7-38d9-43e3-b1fd-668d77c656f7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:11.971981 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ab81579e-7d9d-4643-888f-c04ee49d6103 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:11.975372 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ab81579e-7d9d-4643-888f-c04ee49d6103 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:11.980271 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ab81579e-7d9d-4643-888f-c04ee49d6103 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:11.981505 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ab81579e-7d9d-4643-888f-c04ee49d6103 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:11.981892 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ab81579e-7d9d-4643-888f-c04ee49d6103 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:11.982093 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ab81579e-7d9d-4643-888f-c04ee49d6103 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:12.029286 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-5070d4d7-38d9-43e3-b1fd-668d77c656f7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.082935 Oct 12 18:33:12.029286 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 493/984] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:11 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:33:12.056578 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ab81579e-7d9d-4643-888f-c04ee49d6103 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28194 microversion: 2.1 time: 0.088444 Oct 12 18:33:12.057377 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 492/985] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:11 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28194 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:33:13.041656 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c1687e91-2e69-4ddc-8aac-d1bd567dd365 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:13.043178 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c1687e91-2e69-4ddc-8aac-d1bd567dd365 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:13.049588 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c1687e91-2e69-4ddc-8aac-d1bd567dd365 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:13.050032 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c1687e91-2e69-4ddc-8aac-d1bd567dd365 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:13.050813 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c1687e91-2e69-4ddc-8aac-d1bd567dd365 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:13.051222 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c1687e91-2e69-4ddc-8aac-d1bd567dd365 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:13.078811 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-70684f95-db7e-47b7-96ff-e1285ce58780 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:13.079955 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-70684f95-db7e-47b7-96ff-e1285ce58780 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:13.087690 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-70684f95-db7e-47b7-96ff-e1285ce58780 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:13.088127 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-70684f95-db7e-47b7-96ff-e1285ce58780 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:13.089766 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-70684f95-db7e-47b7-96ff-e1285ce58780 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:13.090195 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-70684f95-db7e-47b7-96ff-e1285ce58780 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:13.142997 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c1687e91-2e69-4ddc-8aac-d1bd567dd365 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.105269 Oct 12 18:33:13.143653 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 494/986] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:13 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:13.159995 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-70684f95-db7e-47b7-96ff-e1285ce58780 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28194 microversion: 2.1 time: 0.085685 Oct 12 18:33:13.160664 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 493/987] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:13 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28194 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:33:14.155946 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-7f1c7d2e-166f-4ff7-bc96-1b6f129a8531 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:14.156963 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-7f1c7d2e-166f-4ff7-bc96-1b6f129a8531 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:14.163384 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7f1c7d2e-166f-4ff7-bc96-1b6f129a8531 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:14.163827 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7f1c7d2e-166f-4ff7-bc96-1b6f129a8531 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:14.164617 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7f1c7d2e-166f-4ff7-bc96-1b6f129a8531 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:14.165047 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7f1c7d2e-166f-4ff7-bc96-1b6f129a8531 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:14.171918 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c99d2bae-fbb0-4b2c-9281-69d46b551bd0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:14.173056 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c99d2bae-fbb0-4b2c-9281-69d46b551bd0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:14.179393 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c99d2bae-fbb0-4b2c-9281-69d46b551bd0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:14.179844 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c99d2bae-fbb0-4b2c-9281-69d46b551bd0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:14.180633 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c99d2bae-fbb0-4b2c-9281-69d46b551bd0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:14.181066 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c99d2bae-fbb0-4b2c-9281-69d46b551bd0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:14.237715 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-7f1c7d2e-166f-4ff7-bc96-1b6f129a8531 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.085908 Oct 12 18:33:14.238369 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 495/988] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:14 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:33:14.254051 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c99d2bae-fbb0-4b2c-9281-69d46b551bd0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28194 microversion: 2.1 time: 0.085870 Oct 12 18:33:14.254697 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 494/989] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:14 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28194 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:33:15.251918 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-19c27142-613e-4f05-85ac-cdbee451fd20 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:15.252941 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-19c27142-613e-4f05-85ac-cdbee451fd20 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:15.259428 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-19c27142-613e-4f05-85ac-cdbee451fd20 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:15.259850 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-19c27142-613e-4f05-85ac-cdbee451fd20 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:15.261014 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-19c27142-613e-4f05-85ac-cdbee451fd20 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:15.261448 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-19c27142-613e-4f05-85ac-cdbee451fd20 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:15.266100 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-be7f5f00-013f-45ac-992a-7e0fa2710ae4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:15.267132 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-be7f5f00-013f-45ac-992a-7e0fa2710ae4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:15.273970 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-be7f5f00-013f-45ac-992a-7e0fa2710ae4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:15.274646 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-be7f5f00-013f-45ac-992a-7e0fa2710ae4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:15.275700 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-be7f5f00-013f-45ac-992a-7e0fa2710ae4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:15.276674 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-be7f5f00-013f-45ac-992a-7e0fa2710ae4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:15.334278 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-19c27142-613e-4f05-85ac-cdbee451fd20 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.086420 Oct 12 18:33:15.334925 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 496/990] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:15 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:15.357122 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-be7f5f00-013f-45ac-992a-7e0fa2710ae4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28485 microversion: 2.1 time: 0.094898 Oct 12 18:33:15.357774 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 495/991] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:15 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28485 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:33:16.346362 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-d36ab662-5254-47ad-9d27-410f9f0ec4eb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:16.347373 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-d36ab662-5254-47ad-9d27-410f9f0ec4eb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:16.354014 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d36ab662-5254-47ad-9d27-410f9f0ec4eb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:16.355762 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d36ab662-5254-47ad-9d27-410f9f0ec4eb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:16.356576 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d36ab662-5254-47ad-9d27-410f9f0ec4eb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:16.357159 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d36ab662-5254-47ad-9d27-410f9f0ec4eb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:16.369118 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5f4fffee-fcec-4af8-a650-0273a3490dd5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:16.370644 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5f4fffee-fcec-4af8-a650-0273a3490dd5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:16.377432 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5f4fffee-fcec-4af8-a650-0273a3490dd5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:16.377871 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5f4fffee-fcec-4af8-a650-0273a3490dd5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:16.381606 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5f4fffee-fcec-4af8-a650-0273a3490dd5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:16.381606 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5f4fffee-fcec-4af8-a650-0273a3490dd5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:16.424524 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-d36ab662-5254-47ad-9d27-410f9f0ec4eb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.081919 Oct 12 18:33:16.425200 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 497/992] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:16 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:16.452477 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5f4fffee-fcec-4af8-a650-0273a3490dd5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28485 microversion: 2.1 time: 0.087088 Oct 12 18:33:16.453127 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 496/993] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:16 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28485 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:33:17.438289 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-325e7dcb-ece5-4704-bb29-13c46ecb5623 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:17.439269 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-325e7dcb-ece5-4704-bb29-13c46ecb5623 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:17.445795 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-325e7dcb-ece5-4704-bb29-13c46ecb5623 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:17.446258 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-325e7dcb-ece5-4704-bb29-13c46ecb5623 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:17.447016 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-325e7dcb-ece5-4704-bb29-13c46ecb5623 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:17.447442 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-325e7dcb-ece5-4704-bb29-13c46ecb5623 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:17.464094 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-09a48733-6cc0-49c4-a011-acc4bfe78260 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:17.465418 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-09a48733-6cc0-49c4-a011-acc4bfe78260 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:17.475886 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-09a48733-6cc0-49c4-a011-acc4bfe78260 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:17.476334 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-09a48733-6cc0-49c4-a011-acc4bfe78260 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:17.477167 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-09a48733-6cc0-49c4-a011-acc4bfe78260 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:17.477603 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-09a48733-6cc0-49c4-a011-acc4bfe78260 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:17.533596 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-325e7dcb-ece5-4704-bb29-13c46ecb5623 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.099323 Oct 12 18:33:17.534253 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 498/994] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:17 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:33:17.592149 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-09a48733-6cc0-49c4-a011-acc4bfe78260 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.132448 Oct 12 18:33:17.592856 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 497/995] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:17 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:33:18.546052 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-0fc2f164-cc96-4176-bb27-c37ca8787fe2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:18.547075 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-0fc2f164-cc96-4176-bb27-c37ca8787fe2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:18.553495 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0fc2f164-cc96-4176-bb27-c37ca8787fe2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:18.553945 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0fc2f164-cc96-4176-bb27-c37ca8787fe2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:18.554707 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0fc2f164-cc96-4176-bb27-c37ca8787fe2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:18.555194 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0fc2f164-cc96-4176-bb27-c37ca8787fe2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:18.603577 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2664139d-7c8c-40f5-ae28-4004169f4d10 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:18.604587 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2664139d-7c8c-40f5-ae28-4004169f4d10 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:18.610952 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2664139d-7c8c-40f5-ae28-4004169f4d10 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:18.611388 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2664139d-7c8c-40f5-ae28-4004169f4d10 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:18.612185 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2664139d-7c8c-40f5-ae28-4004169f4d10 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:18.612639 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2664139d-7c8c-40f5-ae28-4004169f4d10 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:18.623622 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-0fc2f164-cc96-4176-bb27-c37ca8787fe2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.078913 Oct 12 18:33:18.623622 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 499/996] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:18 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:18.688323 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2664139d-7c8c-40f5-ae28-4004169f4d10 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.088505 Oct 12 18:33:18.689238 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 498/997] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:18 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:33:19.633898 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-19c393bd-6d06-40a0-8053-dffa5eeefe90 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:19.634891 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-19c393bd-6d06-40a0-8053-dffa5eeefe90 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:19.641304 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-19c393bd-6d06-40a0-8053-dffa5eeefe90 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:19.641756 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-19c393bd-6d06-40a0-8053-dffa5eeefe90 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:19.642519 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-19c393bd-6d06-40a0-8053-dffa5eeefe90 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:19.642950 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-19c393bd-6d06-40a0-8053-dffa5eeefe90 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:19.701640 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4ecccfc5-d73b-4d2f-84c0-91968fae1977 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:19.702641 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4ecccfc5-d73b-4d2f-84c0-91968fae1977 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:19.711294 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4ecccfc5-d73b-4d2f-84c0-91968fae1977 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:19.711294 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4ecccfc5-d73b-4d2f-84c0-91968fae1977 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:19.711294 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4ecccfc5-d73b-4d2f-84c0-91968fae1977 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:19.711294 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4ecccfc5-d73b-4d2f-84c0-91968fae1977 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:19.718328 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-19c393bd-6d06-40a0-8053-dffa5eeefe90 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.088306 Oct 12 18:33:19.719194 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 500/998] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:19 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:19.773268 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4ecccfc5-d73b-4d2f-84c0-91968fae1977 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.075413 Oct 12 18:33:19.773940 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 499/999] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:19 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:33:20.730664 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-2e5d9c6c-f82c-4ca1-a9a9-fbe430a39ef1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:20.731584 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-2e5d9c6c-f82c-4ca1-a9a9-fbe430a39ef1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:20.738379 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2e5d9c6c-f82c-4ca1-a9a9-fbe430a39ef1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:20.738828 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2e5d9c6c-f82c-4ca1-a9a9-fbe430a39ef1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:20.739606 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2e5d9c6c-f82c-4ca1-a9a9-fbe430a39ef1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:20.740068 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2e5d9c6c-f82c-4ca1-a9a9-fbe430a39ef1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:20.786391 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5aae143c-bce3-47bd-8b3b-c4986966c71c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:20.787376 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5aae143c-bce3-47bd-8b3b-c4986966c71c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:20.793899 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5aae143c-bce3-47bd-8b3b-c4986966c71c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:20.794342 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5aae143c-bce3-47bd-8b3b-c4986966c71c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:20.795117 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5aae143c-bce3-47bd-8b3b-c4986966c71c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:20.795544 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5aae143c-bce3-47bd-8b3b-c4986966c71c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:20.825760 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-2e5d9c6c-f82c-4ca1-a9a9-fbe430a39ef1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.099002 Oct 12 18:33:20.829724 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 501/1000] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:20 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:20.865347 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5aae143c-bce3-47bd-8b3b-c4986966c71c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.082819 Oct 12 18:33:20.870902 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 500/1001] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:20 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:33:21.837848 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-f3a9ddcb-55ec-42a2-8c08-afb67f30ae10 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:21.838871 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-f3a9ddcb-55ec-42a2-8c08-afb67f30ae10 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:21.845594 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f3a9ddcb-55ec-42a2-8c08-afb67f30ae10 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:21.846062 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f3a9ddcb-55ec-42a2-8c08-afb67f30ae10 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:21.846830 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f3a9ddcb-55ec-42a2-8c08-afb67f30ae10 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:21.847288 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f3a9ddcb-55ec-42a2-8c08-afb67f30ae10 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:21.880994 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c99435d5-c538-474a-875e-c6c106ab42b4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:21.881972 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c99435d5-c538-474a-875e-c6c106ab42b4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:21.888358 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c99435d5-c538-474a-875e-c6c106ab42b4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:21.888825 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c99435d5-c538-474a-875e-c6c106ab42b4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:21.889582 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c99435d5-c538-474a-875e-c6c106ab42b4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:21.890005 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c99435d5-c538-474a-875e-c6c106ab42b4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:21.927436 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-f3a9ddcb-55ec-42a2-8c08-afb67f30ae10 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.093482 Oct 12 18:33:21.929044 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 502/1002] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:21 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:21.961831 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c99435d5-c538-474a-875e-c6c106ab42b4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.084431 Oct 12 18:33:21.963360 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 501/1003] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:21 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:33:22.939854 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-3997e80f-597d-4357-ab25-95a1f30319c2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:22.941043 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-3997e80f-597d-4357-ab25-95a1f30319c2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:22.948383 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3997e80f-597d-4357-ab25-95a1f30319c2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:22.948861 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3997e80f-597d-4357-ab25-95a1f30319c2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:22.949639 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3997e80f-597d-4357-ab25-95a1f30319c2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:22.950068 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3997e80f-597d-4357-ab25-95a1f30319c2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:22.991005 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-253bca1a-89a0-45c1-bf78-ca52352c731a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:22.991986 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-253bca1a-89a0-45c1-bf78-ca52352c731a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:22.998928 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-253bca1a-89a0-45c1-bf78-ca52352c731a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:22.999368 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-253bca1a-89a0-45c1-bf78-ca52352c731a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:23.000132 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-253bca1a-89a0-45c1-bf78-ca52352c731a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:23.000591 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-253bca1a-89a0-45c1-bf78-ca52352c731a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:23.025270 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-3997e80f-597d-4357-ab25-95a1f30319c2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.089277 Oct 12 18:33:23.028039 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 503/1004] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:22 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:23.077546 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-253bca1a-89a0-45c1-bf78-ca52352c731a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.091214 Oct 12 18:33:23.078275 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 502/1005] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:22 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:33:24.037715 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-b48aba69-6a69-489e-a938-fd3f9713bc80 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:24.038709 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-b48aba69-6a69-489e-a938-fd3f9713bc80 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:24.045676 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b48aba69-6a69-489e-a938-fd3f9713bc80 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:24.046122 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b48aba69-6a69-489e-a938-fd3f9713bc80 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:24.046886 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b48aba69-6a69-489e-a938-fd3f9713bc80 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:24.047313 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b48aba69-6a69-489e-a938-fd3f9713bc80 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:24.089628 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3052948f-69b2-41c3-b174-0081bd4f5386 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:24.090632 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3052948f-69b2-41c3-b174-0081bd4f5386 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:24.097065 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3052948f-69b2-41c3-b174-0081bd4f5386 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:24.097507 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3052948f-69b2-41c3-b174-0081bd4f5386 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:24.098269 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3052948f-69b2-41c3-b174-0081bd4f5386 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:24.098694 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3052948f-69b2-41c3-b174-0081bd4f5386 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:24.110277 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-b48aba69-6a69-489e-a938-fd3f9713bc80 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.076403 Oct 12 18:33:24.114242 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 504/1006] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:24 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:24.167602 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3052948f-69b2-41c3-b174-0081bd4f5386 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.081145 Oct 12 18:33:24.168250 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 503/1007] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:24 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:33:25.124938 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-aa96ca9a-27a2-4f22-9ce6-138f21dec50f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:25.125996 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-aa96ca9a-27a2-4f22-9ce6-138f21dec50f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:25.133088 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-aa96ca9a-27a2-4f22-9ce6-138f21dec50f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:25.133536 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-aa96ca9a-27a2-4f22-9ce6-138f21dec50f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:25.134309 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-aa96ca9a-27a2-4f22-9ce6-138f21dec50f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:25.134792 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-aa96ca9a-27a2-4f22-9ce6-138f21dec50f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:25.179636 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-40ed4f92-2294-4775-b408-da482c703f7c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:25.180681 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-40ed4f92-2294-4775-b408-da482c703f7c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:25.187666 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-40ed4f92-2294-4775-b408-da482c703f7c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:25.188115 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-40ed4f92-2294-4775-b408-da482c703f7c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:25.188909 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-40ed4f92-2294-4775-b408-da482c703f7c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:25.189343 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-40ed4f92-2294-4775-b408-da482c703f7c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:25.202959 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-aa96ca9a-27a2-4f22-9ce6-138f21dec50f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.083929 Oct 12 18:33:25.203637 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 505/1008] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:25 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:33:25.259364 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-40ed4f92-2294-4775-b408-da482c703f7c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.083547 Oct 12 18:33:25.260849 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 504/1009] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:25 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:33:26.214864 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-b041402d-69c5-4210-b748-f0859d9e7fee tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:26.215848 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-b041402d-69c5-4210-b748-f0859d9e7fee tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:26.222326 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b041402d-69c5-4210-b748-f0859d9e7fee tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:26.222770 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b041402d-69c5-4210-b748-f0859d9e7fee tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:26.223535 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b041402d-69c5-4210-b748-f0859d9e7fee tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:26.223963 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b041402d-69c5-4210-b748-f0859d9e7fee tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:26.271501 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5f4f2ac2-39fd-43dd-b01f-93f918d00cb4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:26.272544 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5f4f2ac2-39fd-43dd-b01f-93f918d00cb4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:26.279331 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5f4f2ac2-39fd-43dd-b01f-93f918d00cb4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:26.279779 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5f4f2ac2-39fd-43dd-b01f-93f918d00cb4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:26.280576 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5f4f2ac2-39fd-43dd-b01f-93f918d00cb4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:26.281008 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5f4f2ac2-39fd-43dd-b01f-93f918d00cb4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:26.288688 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-b041402d-69c5-4210-b748-f0859d9e7fee tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.077668 Oct 12 18:33:26.293284 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 506/1010] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:26 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:33:26.344456 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5f4f2ac2-39fd-43dd-b01f-93f918d00cb4 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.076769 Oct 12 18:33:26.345329 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 505/1011] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:26 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:33:27.301499 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-58c0e4f5-0567-44b3-8741-76591ead56f8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:27.302489 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-58c0e4f5-0567-44b3-8741-76591ead56f8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:27.308941 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-58c0e4f5-0567-44b3-8741-76591ead56f8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:27.309394 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-58c0e4f5-0567-44b3-8741-76591ead56f8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:27.310210 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-58c0e4f5-0567-44b3-8741-76591ead56f8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:27.310640 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-58c0e4f5-0567-44b3-8741-76591ead56f8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:27.356026 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-674fc0ad-4795-40d4-b452-a7fb482dfb09 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:27.357048 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-674fc0ad-4795-40d4-b452-a7fb482dfb09 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:27.363618 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-674fc0ad-4795-40d4-b452-a7fb482dfb09 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:27.364064 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-674fc0ad-4795-40d4-b452-a7fb482dfb09 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:27.364862 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-674fc0ad-4795-40d4-b452-a7fb482dfb09 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:27.365288 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-674fc0ad-4795-40d4-b452-a7fb482dfb09 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:27.370661 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-58c0e4f5-0567-44b3-8741-76591ead56f8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.073012 Oct 12 18:33:27.371633 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 507/1012] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:27 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:27.427043 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-674fc0ad-4795-40d4-b452-a7fb482dfb09 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.075375 Oct 12 18:33:27.427704 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 506/1013] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:27 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:33:28.382946 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-760da39c-88f7-4558-a841-b3b90b2816e9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:28.383940 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-760da39c-88f7-4558-a841-b3b90b2816e9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:28.391136 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-760da39c-88f7-4558-a841-b3b90b2816e9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:28.391579 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-760da39c-88f7-4558-a841-b3b90b2816e9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:28.392342 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-760da39c-88f7-4558-a841-b3b90b2816e9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:28.392847 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-760da39c-88f7-4558-a841-b3b90b2816e9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:28.440745 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ebf3b8cd-c21a-4dee-99ca-fbd6737fc1f5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:28.441740 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ebf3b8cd-c21a-4dee-99ca-fbd6737fc1f5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:28.448123 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ebf3b8cd-c21a-4dee-99ca-fbd6737fc1f5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:28.448615 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ebf3b8cd-c21a-4dee-99ca-fbd6737fc1f5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:28.449378 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ebf3b8cd-c21a-4dee-99ca-fbd6737fc1f5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:28.449806 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ebf3b8cd-c21a-4dee-99ca-fbd6737fc1f5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:28.455210 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-760da39c-88f7-4558-a841-b3b90b2816e9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.076210 Oct 12 18:33:28.456153 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 508/1014] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:28 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:28.515506 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ebf3b8cd-c21a-4dee-99ca-fbd6737fc1f5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.078864 Oct 12 18:33:28.516134 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 507/1015] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:28 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:33:29.467577 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-39bc890a-d7c5-4e3f-b9cc-c40f66c79eb7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:29.468598 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-39bc890a-d7c5-4e3f-b9cc-c40f66c79eb7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:29.475046 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-39bc890a-d7c5-4e3f-b9cc-c40f66c79eb7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:29.475489 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-39bc890a-d7c5-4e3f-b9cc-c40f66c79eb7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:29.476247 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-39bc890a-d7c5-4e3f-b9cc-c40f66c79eb7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:29.476709 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-39bc890a-d7c5-4e3f-b9cc-c40f66c79eb7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:29.528060 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9cfa0210-a871-4a9a-bf09-d99f98424675 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:29.529341 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9cfa0210-a871-4a9a-bf09-d99f98424675 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:29.536680 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9cfa0210-a871-4a9a-bf09-d99f98424675 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:29.537133 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9cfa0210-a871-4a9a-bf09-d99f98424675 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:29.537895 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9cfa0210-a871-4a9a-bf09-d99f98424675 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:29.538319 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9cfa0210-a871-4a9a-bf09-d99f98424675 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:29.539033 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-39bc890a-d7c5-4e3f-b9cc-c40f66c79eb7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.075346 Oct 12 18:33:29.540432 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 509/1016] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:29 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:29.599602 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9cfa0210-a871-4a9a-bf09-d99f98424675 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.075899 Oct 12 18:33:29.600257 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 508/1017] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:29 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:33:30.550822 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-8d97ae22-41d2-4087-81e5-cc0b3214a12a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:30.551809 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-8d97ae22-41d2-4087-81e5-cc0b3214a12a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:30.558720 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8d97ae22-41d2-4087-81e5-cc0b3214a12a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:30.559159 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8d97ae22-41d2-4087-81e5-cc0b3214a12a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:30.559908 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8d97ae22-41d2-4087-81e5-cc0b3214a12a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:30.560334 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8d97ae22-41d2-4087-81e5-cc0b3214a12a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:30.612124 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a36fd289-3951-40b4-aefb-24329bf923d0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:30.613156 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a36fd289-3951-40b4-aefb-24329bf923d0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:30.619763 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a36fd289-3951-40b4-aefb-24329bf923d0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:30.620259 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a36fd289-3951-40b4-aefb-24329bf923d0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:30.621573 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a36fd289-3951-40b4-aefb-24329bf923d0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:30.622005 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a36fd289-3951-40b4-aefb-24329bf923d0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:30.623718 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-8d97ae22-41d2-4087-81e5-cc0b3214a12a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.076737 Oct 12 18:33:30.625348 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 510/1018] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:30 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:30.683619 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a36fd289-3951-40b4-aefb-24329bf923d0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.074911 Oct 12 18:33:30.684280 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 509/1019] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:30 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:33:31.636617 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-b8588660-0e81-4d8c-ac18-a963188b5bb6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:31.637614 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-b8588660-0e81-4d8c-ac18-a963188b5bb6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:31.643879 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b8588660-0e81-4d8c-ac18-a963188b5bb6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:31.644316 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b8588660-0e81-4d8c-ac18-a963188b5bb6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:31.645269 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b8588660-0e81-4d8c-ac18-a963188b5bb6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:31.645696 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b8588660-0e81-4d8c-ac18-a963188b5bb6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:31.695963 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d224878f-a781-454b-ad1a-b916df9b00ae tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:31.696975 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d224878f-a781-454b-ad1a-b916df9b00ae tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:31.703421 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d224878f-a781-454b-ad1a-b916df9b00ae tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:31.703865 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d224878f-a781-454b-ad1a-b916df9b00ae tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:31.704666 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d224878f-a781-454b-ad1a-b916df9b00ae tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:31.705095 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d224878f-a781-454b-ad1a-b916df9b00ae tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:31.706904 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-b8588660-0e81-4d8c-ac18-a963188b5bb6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.074679 Oct 12 18:33:31.707962 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 511/1020] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:31 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:31.766919 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d224878f-a781-454b-ad1a-b916df9b00ae tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.075178 Oct 12 18:33:31.767592 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 510/1021] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:31 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:33:32.719817 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-84936e3f-42b5-4020-a012-3f16a4c5b59a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:32.720829 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-84936e3f-42b5-4020-a012-3f16a4c5b59a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:32.727485 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-84936e3f-42b5-4020-a012-3f16a4c5b59a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:32.727934 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-84936e3f-42b5-4020-a012-3f16a4c5b59a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:32.728709 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-84936e3f-42b5-4020-a012-3f16a4c5b59a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:32.729137 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-84936e3f-42b5-4020-a012-3f16a4c5b59a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:32.779765 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-73835366-68b8-4043-bff7-14a6ca482c7e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:32.780770 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-73835366-68b8-4043-bff7-14a6ca482c7e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:32.787099 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-73835366-68b8-4043-bff7-14a6ca482c7e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:32.787589 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-73835366-68b8-4043-bff7-14a6ca482c7e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:32.788292 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-73835366-68b8-4043-bff7-14a6ca482c7e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:32.788745 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-73835366-68b8-4043-bff7-14a6ca482c7e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:32.796854 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-84936e3f-42b5-4020-a012-3f16a4c5b59a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.080789 Oct 12 18:33:32.798616 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 512/1022] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:32 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:32.876668 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-73835366-68b8-4043-bff7-14a6ca482c7e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.100934 Oct 12 18:33:32.877793 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 511/1023] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:32 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:33:33.809551 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-290c7bf5-e561-47af-bd63-754cbfd61363 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:33.810590 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-290c7bf5-e561-47af-bd63-754cbfd61363 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:33.816964 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-290c7bf5-e561-47af-bd63-754cbfd61363 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:33.817398 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-290c7bf5-e561-47af-bd63-754cbfd61363 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:33.818149 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-290c7bf5-e561-47af-bd63-754cbfd61363 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:33.818573 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-290c7bf5-e561-47af-bd63-754cbfd61363 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:33.883608 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-290c7bf5-e561-47af-bd63-754cbfd61363 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.078474 Oct 12 18:33:33.884345 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 513/1024] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:33 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:33.888620 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-39bf8691-ebc6-4ae3-b3a8-90987f83079d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:33.889600 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-39bf8691-ebc6-4ae3-b3a8-90987f83079d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:33.896069 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-39bf8691-ebc6-4ae3-b3a8-90987f83079d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:33.896552 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-39bf8691-ebc6-4ae3-b3a8-90987f83079d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:33.897530 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-39bf8691-ebc6-4ae3-b3a8-90987f83079d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:33.897962 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-39bf8691-ebc6-4ae3-b3a8-90987f83079d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:33.959002 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-39bf8691-ebc6-4ae3-b3a8-90987f83079d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.074099 Oct 12 18:33:33.959627 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 512/1025] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:33 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:33:34.896028 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-63ae09b7-f94c-4d34-b5bc-7304a0872df1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:34.896966 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-63ae09b7-f94c-4d34-b5bc-7304a0872df1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:34.903528 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-63ae09b7-f94c-4d34-b5bc-7304a0872df1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:34.904241 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-63ae09b7-f94c-4d34-b5bc-7304a0872df1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:34.905040 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-63ae09b7-f94c-4d34-b5bc-7304a0872df1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:34.905467 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-63ae09b7-f94c-4d34-b5bc-7304a0872df1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:34.970889 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9f3375d1-38ed-4e7f-b2b3-8c0771d4ab6a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:34.971503 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-63ae09b7-f94c-4d34-b5bc-7304a0872df1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.078934 Oct 12 18:33:34.971936 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 514/1026] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:34 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:33:34.972050 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9f3375d1-38ed-4e7f-b2b3-8c0771d4ab6a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:34.978675 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9f3375d1-38ed-4e7f-b2b3-8c0771d4ab6a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:34.979116 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9f3375d1-38ed-4e7f-b2b3-8c0771d4ab6a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:34.979889 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9f3375d1-38ed-4e7f-b2b3-8c0771d4ab6a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:34.980320 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9f3375d1-38ed-4e7f-b2b3-8c0771d4ab6a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:35.050769 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9f3375d1-38ed-4e7f-b2b3-8c0771d4ab6a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.083354 Oct 12 18:33:35.051788 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 513/1027] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:34 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:33:35.982775 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-7d1bfac4-9e37-4bd7-8aec-d49ee92d5c17 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:35.983683 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-7d1bfac4-9e37-4bd7-8aec-d49ee92d5c17 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:35.990131 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7d1bfac4-9e37-4bd7-8aec-d49ee92d5c17 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:35.990579 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7d1bfac4-9e37-4bd7-8aec-d49ee92d5c17 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:35.991347 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7d1bfac4-9e37-4bd7-8aec-d49ee92d5c17 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:35.991782 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7d1bfac4-9e37-4bd7-8aec-d49ee92d5c17 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:36.052505 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-7d1bfac4-9e37-4bd7-8aec-d49ee92d5c17 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.073801 Oct 12 18:33:36.053138 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 515/1028] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:35 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:36.062961 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0e293475-8f10-4361-a03f-9f586bbeebc3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:36.063953 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0e293475-8f10-4361-a03f-9f586bbeebc3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:36.070428 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0e293475-8f10-4361-a03f-9f586bbeebc3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:36.070876 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0e293475-8f10-4361-a03f-9f586bbeebc3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:36.071678 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0e293475-8f10-4361-a03f-9f586bbeebc3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:36.072122 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0e293475-8f10-4361-a03f-9f586bbeebc3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:36.130928 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0e293475-8f10-4361-a03f-9f586bbeebc3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.071685 Oct 12 18:33:36.131541 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 514/1029] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:36 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:33:36.149482 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-fa8d3b04-6fd3-4c7a-8d23-22b13ae30fcf tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc8fb063-e615-452c-bc41-731b9eda5000", "device": "/dev/sdb"}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:36.151106 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-fa8d3b04-6fd3-4c7a-8d23-22b13ae30fcf tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: c507ce79-0fb1-47d8-b6bf-9992f9d9484a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:36.158422 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fa8d3b04-6fd3-4c7a-8d23-22b13ae30fcf tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:36.158874 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fa8d3b04-6fd3-4c7a-8d23-22b13ae30fcf tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:36.159640 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fa8d3b04-6fd3-4c7a-8d23-22b13ae30fcf tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:36.160071 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fa8d3b04-6fd3-4c7a-8d23-22b13ae30fcf tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:36.844786 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-fa8d3b04-6fd3-4c7a-8d23-22b13ae30fcf tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "POST /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.699092 Oct 12 18:33:36.845635 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 516/1030] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Oct 12 18:33:36 2021] POST /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a/os-volume_attachments => generated 194 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:33:37.064808 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-90ef4d67-0b07-4579-9cd0-020e3c334e67 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:37.065823 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-90ef4d67-0b07-4579-9cd0-020e3c334e67 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:37.072207 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-90ef4d67-0b07-4579-9cd0-020e3c334e67 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:37.072687 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-90ef4d67-0b07-4579-9cd0-020e3c334e67 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:37.073489 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-90ef4d67-0b07-4579-9cd0-020e3c334e67 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:37.073919 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-90ef4d67-0b07-4579-9cd0-020e3c334e67 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:37.137096 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-90ef4d67-0b07-4579-9cd0-020e3c334e67 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.076370 Oct 12 18:33:37.137710 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 515/1031] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:37 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:37.152100 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-5bd6bc82-db10-49d9-9d57-07e0647165f2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:37.153126 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-5bd6bc82-db10-49d9-9d57-07e0647165f2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:37.159431 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5bd6bc82-db10-49d9-9d57-07e0647165f2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:37.159868 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5bd6bc82-db10-49d9-9d57-07e0647165f2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:37.160656 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5bd6bc82-db10-49d9-9d57-07e0647165f2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:37.161087 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5bd6bc82-db10-49d9-9d57-07e0647165f2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:37.241025 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-5bd6bc82-db10-49d9-9d57-07e0647165f2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.093214 Oct 12 18:33:37.241811 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 517/1032] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:37 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:33:38.149173 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-455e0d5b-ed2c-4229-8ac1-f594c817e5af tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:38.150160 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-455e0d5b-ed2c-4229-8ac1-f594c817e5af tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:38.156882 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-455e0d5b-ed2c-4229-8ac1-f594c817e5af tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:38.157278 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-455e0d5b-ed2c-4229-8ac1-f594c817e5af tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:38.158040 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-455e0d5b-ed2c-4229-8ac1-f594c817e5af tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:38.158473 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-455e0d5b-ed2c-4229-8ac1-f594c817e5af tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:38.218913 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-455e0d5b-ed2c-4229-8ac1-f594c817e5af tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.073649 Oct 12 18:33:38.219547 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 516/1033] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:38 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:38.253934 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-3b969a26-7146-48d0-b118-255dcf3c1b11 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:38.255340 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-3b969a26-7146-48d0-b118-255dcf3c1b11 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:38.263166 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3b969a26-7146-48d0-b118-255dcf3c1b11 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:38.263604 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3b969a26-7146-48d0-b118-255dcf3c1b11 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:38.264370 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3b969a26-7146-48d0-b118-255dcf3c1b11 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:38.264823 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3b969a26-7146-48d0-b118-255dcf3c1b11 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:38.338635 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-3b969a26-7146-48d0-b118-255dcf3c1b11 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.089607 Oct 12 18:33:38.340135 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 518/1034] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:38 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:33:39.231305 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-15efbd70-3775-40d9-9c85-0e60a49b899f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:39.232203 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-15efbd70-3775-40d9-9c85-0e60a49b899f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:39.238691 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-15efbd70-3775-40d9-9c85-0e60a49b899f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:39.239134 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-15efbd70-3775-40d9-9c85-0e60a49b899f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:39.239928 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-15efbd70-3775-40d9-9c85-0e60a49b899f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:39.240325 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-15efbd70-3775-40d9-9c85-0e60a49b899f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:39.305677 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-15efbd70-3775-40d9-9c85-0e60a49b899f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.078484 Oct 12 18:33:39.306320 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 517/1035] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:39 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:39.350813 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-69cad9cf-bc1a-4974-9abf-3b532ccf55e6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:39.351822 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-69cad9cf-bc1a-4974-9abf-3b532ccf55e6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:39.358383 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-69cad9cf-bc1a-4974-9abf-3b532ccf55e6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:39.358824 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-69cad9cf-bc1a-4974-9abf-3b532ccf55e6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:39.359604 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-69cad9cf-bc1a-4974-9abf-3b532ccf55e6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:39.360028 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-69cad9cf-bc1a-4974-9abf-3b532ccf55e6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:39.435551 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-69cad9cf-bc1a-4974-9abf-3b532ccf55e6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.088674 Oct 12 18:33:39.436207 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 519/1036] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:39 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:33:40.318468 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-65ed9cba-6835-400e-8590-c77b925d3797 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:40.319480 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-65ed9cba-6835-400e-8590-c77b925d3797 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:40.325977 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-65ed9cba-6835-400e-8590-c77b925d3797 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:40.326423 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-65ed9cba-6835-400e-8590-c77b925d3797 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:40.327185 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-65ed9cba-6835-400e-8590-c77b925d3797 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:40.327612 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-65ed9cba-6835-400e-8590-c77b925d3797 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:40.399362 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-65ed9cba-6835-400e-8590-c77b925d3797 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.084810 Oct 12 18:33:40.400900 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 518/1037] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:40 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:40.447484 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-334eca99-0aaf-4dcb-8469-b75be62a71e2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:40.449011 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-334eca99-0aaf-4dcb-8469-b75be62a71e2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:40.455589 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-334eca99-0aaf-4dcb-8469-b75be62a71e2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:40.456033 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-334eca99-0aaf-4dcb-8469-b75be62a71e2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:40.457044 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-334eca99-0aaf-4dcb-8469-b75be62a71e2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:40.457482 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-334eca99-0aaf-4dcb-8469-b75be62a71e2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:40.524077 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-334eca99-0aaf-4dcb-8469-b75be62a71e2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.080322 Oct 12 18:33:40.528572 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 520/1038] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:40 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:33:41.412540 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-52139bdc-d5b8-47b3-bc8a-4a3079f8834a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:41.413520 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-52139bdc-d5b8-47b3-bc8a-4a3079f8834a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:41.421749 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-52139bdc-d5b8-47b3-bc8a-4a3079f8834a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:41.422188 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-52139bdc-d5b8-47b3-bc8a-4a3079f8834a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:41.423114 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-52139bdc-d5b8-47b3-bc8a-4a3079f8834a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:41.423874 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-52139bdc-d5b8-47b3-bc8a-4a3079f8834a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:41.486021 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-52139bdc-d5b8-47b3-bc8a-4a3079f8834a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.077371 Oct 12 18:33:41.486649 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 519/1039] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:41 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:41.536339 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-ca58b166-0061-4a39-83bb-18f6023753e7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:41.537372 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-ca58b166-0061-4a39-83bb-18f6023753e7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:41.544567 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ca58b166-0061-4a39-83bb-18f6023753e7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:41.545006 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ca58b166-0061-4a39-83bb-18f6023753e7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:41.545757 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ca58b166-0061-4a39-83bb-18f6023753e7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:41.546183 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ca58b166-0061-4a39-83bb-18f6023753e7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:41.605866 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-ca58b166-0061-4a39-83bb-18f6023753e7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.073335 Oct 12 18:33:41.606509 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 521/1040] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:41 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:33:42.499200 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1a845736-e407-4577-8aa6-5d8b788171bb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:42.500220 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1a845736-e407-4577-8aa6-5d8b788171bb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:42.506753 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1a845736-e407-4577-8aa6-5d8b788171bb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:42.507199 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1a845736-e407-4577-8aa6-5d8b788171bb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:42.507968 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1a845736-e407-4577-8aa6-5d8b788171bb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:42.508427 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1a845736-e407-4577-8aa6-5d8b788171bb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:42.569126 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1a845736-e407-4577-8aa6-5d8b788171bb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.074259 Oct 12 18:33:42.569776 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 520/1041] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:42 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:42.618079 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-d1954e2a-90f3-4c54-aed0-241b15debadc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:42.619075 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-d1954e2a-90f3-4c54-aed0-241b15debadc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:42.626451 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d1954e2a-90f3-4c54-aed0-241b15debadc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:42.626886 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d1954e2a-90f3-4c54-aed0-241b15debadc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:42.627656 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d1954e2a-90f3-4c54-aed0-241b15debadc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:42.628079 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d1954e2a-90f3-4c54-aed0-241b15debadc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:42.696822 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-d1954e2a-90f3-4c54-aed0-241b15debadc tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.082553 Oct 12 18:33:42.697680 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 522/1042] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:42 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:33:43.581734 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1501c79d-746b-4d06-9cfe-7440dbe11d05 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:43.582716 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1501c79d-746b-4d06-9cfe-7440dbe11d05 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:43.589696 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1501c79d-746b-4d06-9cfe-7440dbe11d05 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:43.590137 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1501c79d-746b-4d06-9cfe-7440dbe11d05 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:43.590890 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1501c79d-746b-4d06-9cfe-7440dbe11d05 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:43.591314 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1501c79d-746b-4d06-9cfe-7440dbe11d05 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:43.659222 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1501c79d-746b-4d06-9cfe-7440dbe11d05 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 28633 microversion: 2.20 time: 0.081331 Oct 12 18:33:43.659867 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 521/1043] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:43 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 28633 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:43.708689 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-bd6c8e8a-7579-4535-82dd-0d03fae21705 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:43.709705 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-bd6c8e8a-7579-4535-82dd-0d03fae21705 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:43.716811 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bd6c8e8a-7579-4535-82dd-0d03fae21705 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:43.717254 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bd6c8e8a-7579-4535-82dd-0d03fae21705 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:43.718017 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bd6c8e8a-7579-4535-82dd-0d03fae21705 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:43.718442 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bd6c8e8a-7579-4535-82dd-0d03fae21705 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:43.778436 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-bd6c8e8a-7579-4535-82dd-0d03fae21705 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.073549 Oct 12 18:33:43.779371 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 523/1044] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:43 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:33:44.672045 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d8ffd5a1-57ec-48b2-b13f-3a0eae3ad925 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:44.673089 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d8ffd5a1-57ec-48b2-b13f-3a0eae3ad925 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:44.679979 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d8ffd5a1-57ec-48b2-b13f-3a0eae3ad925 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:44.680446 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d8ffd5a1-57ec-48b2-b13f-3a0eae3ad925 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:44.681218 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d8ffd5a1-57ec-48b2-b13f-3a0eae3ad925 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:44.681646 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d8ffd5a1-57ec-48b2-b13f-3a0eae3ad925 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:44.759380 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d8ffd5a1-57ec-48b2-b13f-3a0eae3ad925 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 29633 microversion: 2.20 time: 0.091200 Oct 12 18:33:44.760263 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 522/1045] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:44 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 29633 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:33:44.792472 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-6df6b1c4-2233-4d8b-a223-a49b8f7d8b72 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:44.793495 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-6df6b1c4-2233-4d8b-a223-a49b8f7d8b72 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:44.806061 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6df6b1c4-2233-4d8b-a223-a49b8f7d8b72 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:44.806061 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6df6b1c4-2233-4d8b-a223-a49b8f7d8b72 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:44.806061 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6df6b1c4-2233-4d8b-a223-a49b8f7d8b72 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:44.806061 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6df6b1c4-2233-4d8b-a223-a49b8f7d8b72 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:44.872530 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-6df6b1c4-2233-4d8b-a223-a49b8f7d8b72 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.076495 Oct 12 18:33:44.872530 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 524/1046] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:44 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:33:45.771990 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a18da127-ce3e-44dd-aaa2-3fb7086023f2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:45.773220 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a18da127-ce3e-44dd-aaa2-3fb7086023f2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:45.780809 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a18da127-ce3e-44dd-aaa2-3fb7086023f2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:45.781248 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a18da127-ce3e-44dd-aaa2-3fb7086023f2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:45.782013 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a18da127-ce3e-44dd-aaa2-3fb7086023f2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:45.782439 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a18da127-ce3e-44dd-aaa2-3fb7086023f2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:45.882232 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-14c4d7df-131e-4349-8be4-37bbcd4716b5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:45.883136 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-14c4d7df-131e-4349-8be4-37bbcd4716b5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:45.890213 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-14c4d7df-131e-4349-8be4-37bbcd4716b5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:45.890662 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-14c4d7df-131e-4349-8be4-37bbcd4716b5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:45.891416 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-14c4d7df-131e-4349-8be4-37bbcd4716b5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:45.891838 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-14c4d7df-131e-4349-8be4-37bbcd4716b5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:49.377979 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a18da127-ce3e-44dd-aaa2-3fb7086023f2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 35033 microversion: 2.20 time: 3.610123 Oct 12 18:33:49.378685 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 523/1047] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:45 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 35033 bytes in 3612 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:49.391298 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-14c4d7df-131e-4349-8be4-37bbcd4716b5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 3.513317 Oct 12 18:33:49.391946 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 525/1048] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:45 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 3515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:33:50.391177 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8a04461f-6b24-4689-9c54-2d0d873d0d03 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:50.392083 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8a04461f-6b24-4689-9c54-2d0d873d0d03 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:50.398671 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8a04461f-6b24-4689-9c54-2d0d873d0d03 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:50.399116 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8a04461f-6b24-4689-9c54-2d0d873d0d03 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:50.399897 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8a04461f-6b24-4689-9c54-2d0d873d0d03 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:50.400327 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8a04461f-6b24-4689-9c54-2d0d873d0d03 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:50.405051 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-8cff0d5e-7cfa-4249-907d-b5b828249067 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:50.406051 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-8cff0d5e-7cfa-4249-907d-b5b828249067 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:50.412571 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8cff0d5e-7cfa-4249-907d-b5b828249067 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:50.413012 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8cff0d5e-7cfa-4249-907d-b5b828249067 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:50.413771 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8cff0d5e-7cfa-4249-907d-b5b828249067 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:50.414196 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8cff0d5e-7cfa-4249-907d-b5b828249067 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:50.504445 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8a04461f-6b24-4689-9c54-2d0d873d0d03 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 36463 microversion: 2.20 time: 0.117806 Oct 12 18:33:50.505102 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 524/1049] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:50 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 36463 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:50.510815 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-8cff0d5e-7cfa-4249-907d-b5b828249067 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.110519 Oct 12 18:33:50.511456 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 526/1050] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:50 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:33:51.516932 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1a107eb1-b757-48c2-b945-ba6f6411c9e4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:51.518002 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1a107eb1-b757-48c2-b945-ba6f6411c9e4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:51.523755 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-5d3177fb-55dd-4bd2-84f5-69be17a037f8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:51.524782 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1a107eb1-b757-48c2-b945-ba6f6411c9e4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:51.525108 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-5d3177fb-55dd-4bd2-84f5-69be17a037f8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:51.525243 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1a107eb1-b757-48c2-b945-ba6f6411c9e4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:51.525986 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1a107eb1-b757-48c2-b945-ba6f6411c9e4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:51.526415 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1a107eb1-b757-48c2-b945-ba6f6411c9e4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:51.532094 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5d3177fb-55dd-4bd2-84f5-69be17a037f8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:51.532565 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5d3177fb-55dd-4bd2-84f5-69be17a037f8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:51.533543 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5d3177fb-55dd-4bd2-84f5-69be17a037f8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:51.534116 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5d3177fb-55dd-4bd2-84f5-69be17a037f8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:51.616112 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1a107eb1-b757-48c2-b945-ba6f6411c9e4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 37777 microversion: 2.20 time: 0.102986 Oct 12 18:33:51.617806 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 525/1051] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:51 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 37777 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:51.620646 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-5d3177fb-55dd-4bd2-84f5-69be17a037f8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.101130 Oct 12 18:33:51.621347 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 527/1052] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:51 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:33:52.628914 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d7da1c4e-14ef-4be6-b205-d7d65ddae7d8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:52.629913 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d7da1c4e-14ef-4be6-b205-d7d65ddae7d8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:52.633774 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-07ff357a-627d-4803-9a7a-3c5ed4398304 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:52.634796 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-07ff357a-627d-4803-9a7a-3c5ed4398304 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:52.636578 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d7da1c4e-14ef-4be6-b205-d7d65ddae7d8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:52.637057 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d7da1c4e-14ef-4be6-b205-d7d65ddae7d8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:52.637839 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d7da1c4e-14ef-4be6-b205-d7d65ddae7d8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:52.638343 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d7da1c4e-14ef-4be6-b205-d7d65ddae7d8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:52.641447 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-07ff357a-627d-4803-9a7a-3c5ed4398304 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:52.641898 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-07ff357a-627d-4803-9a7a-3c5ed4398304 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:52.642682 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-07ff357a-627d-4803-9a7a-3c5ed4398304 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:52.643111 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-07ff357a-627d-4803-9a7a-3c5ed4398304 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:54.447733 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d7da1c4e-14ef-4be6-b205-d7d65ddae7d8 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 38176 microversion: 2.20 time: 1.822623 Oct 12 18:33:54.452906 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 526/1053] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:52 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 38176 bytes in 1826 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:54.453370 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-07ff357a-627d-4803-9a7a-3c5ed4398304 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 1.820235 Oct 12 18:33:54.453370 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 528/1054] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:52 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 1823 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:33:55.460367 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-bec5a326-c209-4ff1-aaf1-ba3dbff60acc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:55.461448 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-bec5a326-c209-4ff1-aaf1-ba3dbff60acc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:55.466524 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-bf12cd16-8da8-4258-ac60-3e9203c50288 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:55.468124 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bec5a326-c209-4ff1-aaf1-ba3dbff60acc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:55.468267 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-bf12cd16-8da8-4258-ac60-3e9203c50288 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:55.468704 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bec5a326-c209-4ff1-aaf1-ba3dbff60acc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:55.469497 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bec5a326-c209-4ff1-aaf1-ba3dbff60acc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:55.469985 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bec5a326-c209-4ff1-aaf1-ba3dbff60acc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:55.475940 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bf12cd16-8da8-4258-ac60-3e9203c50288 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:55.476647 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bf12cd16-8da8-4258-ac60-3e9203c50288 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:55.477339 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bf12cd16-8da8-4258-ac60-3e9203c50288 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:55.477781 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bf12cd16-8da8-4258-ac60-3e9203c50288 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:56.058394 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-bec5a326-c209-4ff1-aaf1-ba3dbff60acc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 38176 microversion: 2.20 time: 0.601912 Oct 12 18:33:56.062369 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 527/1055] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:55 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 38176 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:56.070594 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-bf12cd16-8da8-4258-ac60-3e9203c50288 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.607394 Oct 12 18:33:56.070594 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 529/1056] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:55 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:33:57.071164 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c902d6cf-c313-42d5-a13f-043f72bb9264 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:57.072155 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c902d6cf-c313-42d5-a13f-043f72bb9264 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:57.080169 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c902d6cf-c313-42d5-a13f-043f72bb9264 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:57.080641 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c902d6cf-c313-42d5-a13f-043f72bb9264 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:57.081422 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c902d6cf-c313-42d5-a13f-043f72bb9264 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:57.081855 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c902d6cf-c313-42d5-a13f-043f72bb9264 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:57.082657 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-e2a5b20d-2107-4ab8-8a8f-a534ce6f70b2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:57.083669 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-e2a5b20d-2107-4ab8-8a8f-a534ce6f70b2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:57.090032 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e2a5b20d-2107-4ab8-8a8f-a534ce6f70b2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:57.090479 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e2a5b20d-2107-4ab8-8a8f-a534ce6f70b2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:57.091822 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e2a5b20d-2107-4ab8-8a8f-a534ce6f70b2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:57.092307 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e2a5b20d-2107-4ab8-8a8f-a534ce6f70b2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:57.157947 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c902d6cf-c313-42d5-a13f-043f72bb9264 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 38176 microversion: 2.20 time: 0.090613 Oct 12 18:33:57.158639 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 528/1057] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:57 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 38176 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:57.160799 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-e2a5b20d-2107-4ab8-8a8f-a534ce6f70b2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.082066 Oct 12 18:33:57.161418 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 530/1058] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:57 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:33:58.170424 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-06861d58-fc02-4bda-9748-a99eeb002bdf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:58.171431 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-06861d58-fc02-4bda-9748-a99eeb002bdf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:58.172301 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-ebc74f89-ac41-4ec7-862c-dc107d30cc42 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:58.173364 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-ebc74f89-ac41-4ec7-862c-dc107d30cc42 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:58.178592 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-06861d58-fc02-4bda-9748-a99eeb002bdf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:58.179229 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-06861d58-fc02-4bda-9748-a99eeb002bdf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:58.179865 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ebc74f89-ac41-4ec7-862c-dc107d30cc42 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:58.180149 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-06861d58-fc02-4bda-9748-a99eeb002bdf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:58.180310 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ebc74f89-ac41-4ec7-862c-dc107d30cc42 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:58.180609 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-06861d58-fc02-4bda-9748-a99eeb002bdf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:58.181111 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ebc74f89-ac41-4ec7-862c-dc107d30cc42 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:58.181606 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ebc74f89-ac41-4ec7-862c-dc107d30cc42 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:58.260702 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-ebc74f89-ac41-4ec7-862c-dc107d30cc42 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.092022 Oct 12 18:33:58.265211 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 531/1059] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:58 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:33:58.265367 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-06861d58-fc02-4bda-9748-a99eeb002bdf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 38176 microversion: 2.20 time: 0.098726 Oct 12 18:33:58.265890 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 529/1060] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:58 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 38176 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:33:59.273690 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-34b988d9-0ebe-40cd-8bca-e339daeb3fb6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:59.274714 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-34b988d9-0ebe-40cd-8bca-e339daeb3fb6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:59.276917 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-08ae8b96-da43-498b-8403-1a867a817228 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:33:59.277893 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-08ae8b96-da43-498b-8403-1a867a817228 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:33:59.282117 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-34b988d9-0ebe-40cd-8bca-e339daeb3fb6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:59.282564 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-34b988d9-0ebe-40cd-8bca-e339daeb3fb6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:59.283334 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-34b988d9-0ebe-40cd-8bca-e339daeb3fb6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:59.283762 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-34b988d9-0ebe-40cd-8bca-e339daeb3fb6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:59.285075 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-08ae8b96-da43-498b-8403-1a867a817228 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:59.285517 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-08ae8b96-da43-498b-8403-1a867a817228 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:33:59.286271 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-08ae8b96-da43-498b-8403-1a867a817228 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:33:59.286746 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-08ae8b96-da43-498b-8403-1a867a817228 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:02.245559 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-34b988d9-0ebe-40cd-8bca-e339daeb3fb6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 2.975892 Oct 12 18:34:02.246216 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 532/1061] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:33:59 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 2978 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:34:02.262247 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-08ae8b96-da43-498b-8403-1a867a817228 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 200 len: 38317 microversion: 2.20 time: 2.989259 Oct 12 18:34:02.268240 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 530/1062] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:33:59 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 38317 bytes in 2992 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:34:02.277470 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-aae53acb-336b-49d0-9d79-eb25c9de07e1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:02.278051 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-aae53acb-336b-49d0-9d79-eb25c9de07e1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:02.285607 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-aae53acb-336b-49d0-9d79-eb25c9de07e1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:02.286058 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-aae53acb-336b-49d0-9d79-eb25c9de07e1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:02.286838 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-aae53acb-336b-49d0-9d79-eb25c9de07e1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:02.287271 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-aae53acb-336b-49d0-9d79-eb25c9de07e1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:02.310785 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-aae53acb-336b-49d0-9d79-eb25c9de07e1 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/ips" status: 200 len: 151 microversion: 2.20 time: 0.037297 Oct 12 18:34:02.311281 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 533/1063] 10.222.0.18 () {60 vars in 1288 bytes} [Tue Oct 12 18:34:02 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:34:03.258052 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5fb9ec83-07c4-4dae-9b9e-1c2f8cd2ce85 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:03.259000 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5fb9ec83-07c4-4dae-9b9e-1c2f8cd2ce85 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:03.265612 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5fb9ec83-07c4-4dae-9b9e-1c2f8cd2ce85 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:03.266272 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5fb9ec83-07c4-4dae-9b9e-1c2f8cd2ce85 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:03.266830 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5fb9ec83-07c4-4dae-9b9e-1c2f8cd2ce85 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:03.267259 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5fb9ec83-07c4-4dae-9b9e-1c2f8cd2ce85 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:03.344110 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5fb9ec83-07c4-4dae-9b9e-1c2f8cd2ce85 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.089988 Oct 12 18:34:03.344808 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 531/1064] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:34:03 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:34:04.355655 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-25a4ea52-03bb-4831-885e-fb5a7b319e1a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:04.357140 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-25a4ea52-03bb-4831-885e-fb5a7b319e1a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:04.364228 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-25a4ea52-03bb-4831-885e-fb5a7b319e1a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:04.368140 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-25a4ea52-03bb-4831-885e-fb5a7b319e1a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:04.368140 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-25a4ea52-03bb-4831-885e-fb5a7b319e1a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:04.368140 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-25a4ea52-03bb-4831-885e-fb5a7b319e1a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:04.441199 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-25a4ea52-03bb-4831-885e-fb5a7b319e1a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.089142 Oct 12 18:34:04.447358 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 534/1065] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:34:04 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:34:05.454286 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-225e3613-3142-46a0-8f65-9506ee9adbc9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:05.455281 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-225e3613-3142-46a0-8f65-9506ee9adbc9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:05.464730 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-225e3613-3142-46a0-8f65-9506ee9adbc9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:05.465180 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-225e3613-3142-46a0-8f65-9506ee9adbc9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:05.466505 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-225e3613-3142-46a0-8f65-9506ee9adbc9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:05.466505 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-225e3613-3142-46a0-8f65-9506ee9adbc9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:05.532663 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-225e3613-3142-46a0-8f65-9506ee9adbc9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.082600 Oct 12 18:34:05.533364 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 532/1066] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:34:05 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:34:06.003872 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-18af51e1-6a1a-4819-9dc1-422997c95d8c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:06.004561 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-18af51e1-6a1a-4819-9dc1-422997c95d8c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:06.015611 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-18af51e1-6a1a-4819-9dc1-422997c95d8c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:06.016048 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-18af51e1-6a1a-4819-9dc1-422997c95d8c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:06.016853 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-18af51e1-6a1a-4819-9dc1-422997c95d8c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:06.017285 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-18af51e1-6a1a-4819-9dc1-422997c95d8c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:06.041484 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.objects.instance [None req-18af51e1-6a1a-4819-9dc1-422997c95d8c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lazy-loading 'flavor' on Instance uuid a73458df-c845-4c48-9839-58d3acdfd4da {{(pid=109169) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:34:06.545754 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-19d6bbfa-6875-40c4-9875-ed94fa283af9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:06.546751 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-19d6bbfa-6875-40c4-9875-ed94fa283af9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:06.553740 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-19d6bbfa-6875-40c4-9875-ed94fa283af9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:06.556668 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-19d6bbfa-6875-40c4-9875-ed94fa283af9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:06.556668 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-19d6bbfa-6875-40c4-9875-ed94fa283af9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:06.556668 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-19d6bbfa-6875-40c4-9875-ed94fa283af9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:06.620962 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-19d6bbfa-6875-40c4-9875-ed94fa283af9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.079791 Oct 12 18:34:06.625473 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 533/1067] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:34:06 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:34:06.640949 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-18af51e1-6a1a-4819-9dc1-422997c95d8c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 202 len: 0 microversion: 2.20 time: 0.641035 Oct 12 18:34:06.641747 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 535/1068] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:34:05 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 0 bytes in 643 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 18:34:06.657802 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-bc9b5037-79de-4cc4-a795-399369d8d94e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:06.658499 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-bc9b5037-79de-4cc4-a795-399369d8d94e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:06.665292 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bc9b5037-79de-4cc4-a795-399369d8d94e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:06.665744 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bc9b5037-79de-4cc4-a795-399369d8d94e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:06.666539 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bc9b5037-79de-4cc4-a795-399369d8d94e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:06.666975 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bc9b5037-79de-4cc4-a795-399369d8d94e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:06.799455 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-bc9b5037-79de-4cc4-a795-399369d8d94e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:06.811137 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-bc9b5037-79de-4cc4-a795-399369d8d94e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:06.812741 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-bc9b5037-79de-4cc4-a795-399369d8d94e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:06.813947 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-bc9b5037-79de-4cc4-a795-399369d8d94e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1723 microversion: 2.20 time: 0.161272 Oct 12 18:34:06.814510 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 534/1069] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:06 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:07.634641 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-6c226b8a-a697-4072-a840-c7fa853e5d39 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:07.635623 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-6c226b8a-a697-4072-a840-c7fa853e5d39 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:07.642909 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6c226b8a-a697-4072-a840-c7fa853e5d39 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:07.643342 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6c226b8a-a697-4072-a840-c7fa853e5d39 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:07.644218 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6c226b8a-a697-4072-a840-c7fa853e5d39 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:07.644678 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6c226b8a-a697-4072-a840-c7fa853e5d39 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:07.724606 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-6c226b8a-a697-4072-a840-c7fa853e5d39 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.094563 Oct 12 18:34:07.725445 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 536/1070] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:34:07 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:34:07.741675 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9c0f53c9-e2d0-43f1-9f51-25d6ccbe8e46 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:07.742209 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9c0f53c9-e2d0-43f1-9f51-25d6ccbe8e46 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: c507ce79-0fb1-47d8-b6bf-9992f9d9484a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:07.749102 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9c0f53c9-e2d0-43f1-9f51-25d6ccbe8e46 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:07.749529 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9c0f53c9-e2d0-43f1-9f51-25d6ccbe8e46 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:07.750307 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9c0f53c9-e2d0-43f1-9f51-25d6ccbe8e46 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:07.750738 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9c0f53c9-e2d0-43f1-9f51-25d6ccbe8e46 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:07.833474 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-33fd18a5-fd61-4362-ba98-5039716444f7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:07.834165 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-33fd18a5-fd61-4362-ba98-5039716444f7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:07.837282 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-9c0f53c9-e2d0-43f1-9f51-25d6ccbe8e46 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lazy-loading 'services' on Instance uuid c507ce79-0fb1-47d8-b6bf-9992f9d9484a {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:34:07.840775 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-33fd18a5-fd61-4362-ba98-5039716444f7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:07.841218 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-33fd18a5-fd61-4362-ba98-5039716444f7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:07.841996 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-33fd18a5-fd61-4362-ba98-5039716444f7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:07.842425 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-33fd18a5-fd61-4362-ba98-5039716444f7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:07.975130 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-33fd18a5-fd61-4362-ba98-5039716444f7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:07.982998 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-33fd18a5-fd61-4362-ba98-5039716444f7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:07.984513 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-33fd18a5-fd61-4362-ba98-5039716444f7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:07.985658 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-33fd18a5-fd61-4362-ba98-5039716444f7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1723 microversion: 2.20 time: 0.156526 Oct 12 18:34:07.986220 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 537/1071] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:07 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:34:08.042232 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9c0f53c9-e2d0-43f1-9f51-25d6ccbe8e46 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a/os-volume_attachments/cc8fb063-e615-452c-bc41-731b9eda5000" status: 202 len: 0 microversion: 2.1 time: 0.304168 Oct 12 18:34:08.042861 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 535/1072] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Oct 12 18:34:07 2021] DELETE /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a/os-volume_attachments/cc8fb063-e615-452c-bc41-731b9eda5000 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:34:08.737185 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-d4d93274-5969-4698-9ccb-f3a9b8118330 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:08.738213 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-d4d93274-5969-4698-9ccb-f3a9b8118330 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:08.744099 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d4d93274-5969-4698-9ccb-f3a9b8118330 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:08.744573 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d4d93274-5969-4698-9ccb-f3a9b8118330 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:08.745343 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d4d93274-5969-4698-9ccb-f3a9b8118330 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:08.745770 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d4d93274-5969-4698-9ccb-f3a9b8118330 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:08.811758 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-d4d93274-5969-4698-9ccb-f3a9b8118330 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.078003 Oct 12 18:34:08.812320 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 538/1073] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:34:08 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:34:09.005302 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-24f278cb-3c2a-4cb9-bca7-e441d3796722 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:09.005999 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-24f278cb-3c2a-4cb9-bca7-e441d3796722 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:09.018122 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-24f278cb-3c2a-4cb9-bca7-e441d3796722 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:09.018620 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-24f278cb-3c2a-4cb9-bca7-e441d3796722 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:09.019411 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-24f278cb-3c2a-4cb9-bca7-e441d3796722 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:09.019841 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-24f278cb-3c2a-4cb9-bca7-e441d3796722 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:09.159787 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-24f278cb-3c2a-4cb9-bca7-e441d3796722 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:09.160488 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-b983510d-78d6-47a1-830b-f519eb1b5f14 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:09.161076 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-b983510d-78d6-47a1-830b-f519eb1b5f14 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: c507ce79-0fb1-47d8-b6bf-9992f9d9484a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:09.168289 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b983510d-78d6-47a1-830b-f519eb1b5f14 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:09.168761 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b983510d-78d6-47a1-830b-f519eb1b5f14 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:09.170086 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b983510d-78d6-47a1-830b-f519eb1b5f14 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:09.170784 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b983510d-78d6-47a1-830b-f519eb1b5f14 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:09.171080 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-24f278cb-3c2a-4cb9-bca7-e441d3796722 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:09.173068 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-24f278cb-3c2a-4cb9-bca7-e441d3796722 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:09.174386 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-24f278cb-3c2a-4cb9-bca7-e441d3796722 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1723 microversion: 2.20 time: 0.173226 Oct 12 18:34:09.175142 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 536/1074] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:08 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:09.200199 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-b983510d-78d6-47a1-830b-f519eb1b5f14 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: c507ce79-0fb1-47d8-b6bf-9992f9d9484a] Going to try to terminate instance {{(pid=109169) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 18:34:09.589791 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-b983510d-78d6-47a1-830b-f519eb1b5f14 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a" status: 204 len: 0 microversion: 2.1 time: 0.433439 Oct 12 18:34:09.590576 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 539/1075] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Oct 12 18:34:09 2021] DELETE /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 18:34:09.599204 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b14761ad-2df1-43b6-889f-b49eff015439 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:09.599858 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b14761ad-2df1-43b6-889f-b49eff015439 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: c507ce79-0fb1-47d8-b6bf-9992f9d9484a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:09.608493 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b14761ad-2df1-43b6-889f-b49eff015439 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:09.608493 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b14761ad-2df1-43b6-889f-b49eff015439 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:09.608493 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b14761ad-2df1-43b6-889f-b49eff015439 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:09.608493 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b14761ad-2df1-43b6-889f-b49eff015439 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:09.743929 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b14761ad-2df1-43b6-889f-b49eff015439 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:09.751815 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b14761ad-2df1-43b6-889f-b49eff015439 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a" status: 200 len: 1513 microversion: 2.1 time: 0.156254 Oct 12 18:34:09.752383 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 537/1076] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:34:09 2021] GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:34:09.823085 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-f94b1190-903a-4ecd-8f87-34950e29b45a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:09.824204 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-f94b1190-903a-4ecd-8f87-34950e29b45a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:09.830669 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f94b1190-903a-4ecd-8f87-34950e29b45a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:09.831106 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f94b1190-903a-4ecd-8f87-34950e29b45a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:09.831891 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f94b1190-903a-4ecd-8f87-34950e29b45a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:09.832318 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f94b1190-903a-4ecd-8f87-34950e29b45a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:09.909131 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-f94b1190-903a-4ecd-8f87-34950e29b45a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.089903 Oct 12 18:34:09.909792 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 540/1077] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:34:09 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:34:10.193087 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1de52c5f-83a0-437a-b3af-8b68cf3c201b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:10.193861 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1de52c5f-83a0-437a-b3af-8b68cf3c201b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:10.199498 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1de52c5f-83a0-437a-b3af-8b68cf3c201b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:10.199934 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1de52c5f-83a0-437a-b3af-8b68cf3c201b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:10.201263 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1de52c5f-83a0-437a-b3af-8b68cf3c201b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:10.201724 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1de52c5f-83a0-437a-b3af-8b68cf3c201b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:10.328008 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1de52c5f-83a0-437a-b3af-8b68cf3c201b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:10.341361 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1de52c5f-83a0-437a-b3af-8b68cf3c201b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:10.343007 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1de52c5f-83a0-437a-b3af-8b68cf3c201b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:10.344152 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1de52c5f-83a0-437a-b3af-8b68cf3c201b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1723 microversion: 2.20 time: 0.154922 Oct 12 18:34:10.344734 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 538/1078] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:10 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:10.768738 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-4d41a44e-117d-4393-a99e-d5edfbba54f6 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:10.769448 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-4d41a44e-117d-4393-a99e-d5edfbba54f6 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: c507ce79-0fb1-47d8-b6bf-9992f9d9484a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:10.775784 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4d41a44e-117d-4393-a99e-d5edfbba54f6 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:10.776219 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4d41a44e-117d-4393-a99e-d5edfbba54f6 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:10.777000 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4d41a44e-117d-4393-a99e-d5edfbba54f6 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:10.777424 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4d41a44e-117d-4393-a99e-d5edfbba54f6 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:10.905264 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-4d41a44e-117d-4393-a99e-d5edfbba54f6 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:10.912882 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-4d41a44e-117d-4393-a99e-d5edfbba54f6 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a" status: 200 len: 1513 microversion: 2.1 time: 0.148268 Oct 12 18:34:10.916974 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 541/1079] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:34:10 2021] GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:34:10.921199 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-6bbc3f50-4a2f-4e84-9f1a-1a15b07b4896 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:10.922174 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-6bbc3f50-4a2f-4e84-9f1a-1a15b07b4896 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:10.928235 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6bbc3f50-4a2f-4e84-9f1a-1a15b07b4896 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:10.928709 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6bbc3f50-4a2f-4e84-9f1a-1a15b07b4896 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:10.929550 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6bbc3f50-4a2f-4e84-9f1a-1a15b07b4896 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:10.929943 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6bbc3f50-4a2f-4e84-9f1a-1a15b07b4896 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:10.995054 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-6bbc3f50-4a2f-4e84-9f1a-1a15b07b4896 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.077798 Oct 12 18:34:10.995714 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 539/1080] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:34:10 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:34:11.362185 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-da8e1728-d718-41e9-b15e-1eab9f20f99c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:11.362800 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-da8e1728-d718-41e9-b15e-1eab9f20f99c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:11.368583 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-da8e1728-d718-41e9-b15e-1eab9f20f99c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:11.369031 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-da8e1728-d718-41e9-b15e-1eab9f20f99c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:11.369791 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-da8e1728-d718-41e9-b15e-1eab9f20f99c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:11.370224 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-da8e1728-d718-41e9-b15e-1eab9f20f99c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:11.495270 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-da8e1728-d718-41e9-b15e-1eab9f20f99c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:11.503918 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-da8e1728-d718-41e9-b15e-1eab9f20f99c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:11.505448 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-da8e1728-d718-41e9-b15e-1eab9f20f99c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:11.506663 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-da8e1728-d718-41e9-b15e-1eab9f20f99c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1723 microversion: 2.20 time: 0.148187 Oct 12 18:34:11.507182 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 542/1081] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:11 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:11.932067 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-dfdb2c5d-2207-4623-9498-cf79875d95a1 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:11.932737 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-dfdb2c5d-2207-4623-9498-cf79875d95a1 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: c507ce79-0fb1-47d8-b6bf-9992f9d9484a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:11.940005 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dfdb2c5d-2207-4623-9498-cf79875d95a1 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:11.940546 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dfdb2c5d-2207-4623-9498-cf79875d95a1 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:11.941436 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dfdb2c5d-2207-4623-9498-cf79875d95a1 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:11.941863 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dfdb2c5d-2207-4623-9498-cf79875d95a1 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:12.006910 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-949d3d44-aa25-48ce-8a00-508a439e8781 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:12.007841 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-949d3d44-aa25-48ce-8a00-508a439e8781 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:12.014356 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-949d3d44-aa25-48ce-8a00-508a439e8781 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:12.014805 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-949d3d44-aa25-48ce-8a00-508a439e8781 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:12.015583 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-949d3d44-aa25-48ce-8a00-508a439e8781 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:12.016016 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-949d3d44-aa25-48ce-8a00-508a439e8781 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:12.083164 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-949d3d44-aa25-48ce-8a00-508a439e8781 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.079726 Oct 12 18:34:12.084054 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 543/1082] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:34:12 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:34:12.143821 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-dfdb2c5d-2207-4623-9498-cf79875d95a1 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:12.151337 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-dfdb2c5d-2207-4623-9498-cf79875d95a1 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a" status: 200 len: 1513 microversion: 2.1 time: 0.223672 Oct 12 18:34:12.152014 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 540/1083] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:34:11 2021] GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a => generated 1513 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:34:12.412644 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-f1572a63-d36d-4ee8-91de-5d50c37c557c req-9ef03174-9171-469d-83ce-0bbd1667cfe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c507ce79-0fb1-47d8-b6bf-9992f9d9484a", "name": "network-vif-deleted", "tag": "2efc30ec-72a3-444c-a8d7-f07a6846d636"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:12.414160 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:34:12.414160 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:34:12.422983 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-f1572a63-d36d-4ee8-91de-5d50c37c557c req-9ef03174-9171-469d-83ce-0bbd1667cfe3 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:12.423423 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-f1572a63-d36d-4ee8-91de-5d50c37c557c req-9ef03174-9171-469d-83ce-0bbd1667cfe3 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:12.434478 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-f1572a63-d36d-4ee8-91de-5d50c37c557c req-9ef03174-9171-469d-83ce-0bbd1667cfe3 service nova] Creating event network-vif-deleted:2efc30ec-72a3-444c-a8d7-f07a6846d636 for instance c507ce79-0fb1-47d8-b6bf-9992f9d9484a on hv-cinder-81322 Oct 12 18:34:12.439583 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-f1572a63-d36d-4ee8-91de-5d50c37c557c req-9ef03174-9171-469d-83ce-0bbd1667cfe3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030701 Oct 12 18:34:12.440159 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 544/1084] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:34:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:34:12.525228 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0987d352-b21a-4f77-8c95-11a5f2f4971b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:12.525837 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0987d352-b21a-4f77-8c95-11a5f2f4971b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:12.532475 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0987d352-b21a-4f77-8c95-11a5f2f4971b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:12.540985 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0987d352-b21a-4f77-8c95-11a5f2f4971b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:12.540985 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0987d352-b21a-4f77-8c95-11a5f2f4971b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:12.540985 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0987d352-b21a-4f77-8c95-11a5f2f4971b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:12.671863 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0987d352-b21a-4f77-8c95-11a5f2f4971b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:12.679484 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0987d352-b21a-4f77-8c95-11a5f2f4971b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:12.680996 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0987d352-b21a-4f77-8c95-11a5f2f4971b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:12.682131 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0987d352-b21a-4f77-8c95-11a5f2f4971b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1723 microversion: 2.20 time: 0.160690 Oct 12 18:34:12.682682 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 541/1085] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:12 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:13.095029 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-9c943688-fae8-4fd2-948f-0bf248bd6e7a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:13.096126 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-9c943688-fae8-4fd2-948f-0bf248bd6e7a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:13.102077 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9c943688-fae8-4fd2-948f-0bf248bd6e7a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:13.102522 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9c943688-fae8-4fd2-948f-0bf248bd6e7a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:13.103285 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9c943688-fae8-4fd2-948f-0bf248bd6e7a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:13.103716 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9c943688-fae8-4fd2-948f-0bf248bd6e7a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:13.164181 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-9c943688-fae8-4fd2-948f-0bf248bd6e7a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28652 microversion: 2.1 time: 0.073357 Oct 12 18:34:13.165010 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 545/1086] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:34:13 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28652 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:34:13.170783 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0e4cf63a-46e2-4e8e-89fa-7a77c01a2e89 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:13.171415 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0e4cf63a-46e2-4e8e-89fa-7a77c01a2e89 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: c507ce79-0fb1-47d8-b6bf-9992f9d9484a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:13.177800 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0e4cf63a-46e2-4e8e-89fa-7a77c01a2e89 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:13.178244 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0e4cf63a-46e2-4e8e-89fa-7a77c01a2e89 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:13.179000 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0e4cf63a-46e2-4e8e-89fa-7a77c01a2e89 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:13.179462 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0e4cf63a-46e2-4e8e-89fa-7a77c01a2e89 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:13.208760 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0e4cf63a-46e2-4e8e-89fa-7a77c01a2e89 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:13.209194 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0e4cf63a-46e2-4e8e-89fa-7a77c01a2e89 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:13.209633 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-0e4cf63a-46e2-4e8e-89fa-7a77c01a2e89 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lazy-loading 'fault' on Instance uuid c507ce79-0fb1-47d8-b6bf-9992f9d9484a {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:34:13.248912 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0e4cf63a-46e2-4e8e-89fa-7a77c01a2e89 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:13.255971 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0e4cf63a-46e2-4e8e-89fa-7a77c01a2e89 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a" status: 200 len: 1309 microversion: 2.1 time: 0.089391 Oct 12 18:34:13.256544 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 542/1087] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:34:13 2021] GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a => generated 1309 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:34:13.701131 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-0489fcc5-74e3-4e8c-8d8e-cbf495832324 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:13.701816 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-0489fcc5-74e3-4e8c-8d8e-cbf495832324 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:13.708174 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0489fcc5-74e3-4e8c-8d8e-cbf495832324 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:13.708651 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0489fcc5-74e3-4e8c-8d8e-cbf495832324 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:13.709409 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0489fcc5-74e3-4e8c-8d8e-cbf495832324 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:13.709828 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0489fcc5-74e3-4e8c-8d8e-cbf495832324 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:13.834622 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-0489fcc5-74e3-4e8c-8d8e-cbf495832324 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:13.843511 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-0489fcc5-74e3-4e8c-8d8e-cbf495832324 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:13.845034 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-0489fcc5-74e3-4e8c-8d8e-cbf495832324 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:13.846183 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-0489fcc5-74e3-4e8c-8d8e-cbf495832324 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1723 microversion: 2.20 time: 0.149765 Oct 12 18:34:13.846729 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 546/1088] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:13 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:14.176057 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a894aac2-83a5-4bfb-bc63-c44391cbf6da tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:14.176950 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a894aac2-83a5-4bfb-bc63-c44391cbf6da tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:14.182752 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a894aac2-83a5-4bfb-bc63-c44391cbf6da tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:14.183195 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a894aac2-83a5-4bfb-bc63-c44391cbf6da tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:14.183962 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a894aac2-83a5-4bfb-bc63-c44391cbf6da tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:14.184390 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a894aac2-83a5-4bfb-bc63-c44391cbf6da tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:14.258716 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a894aac2-83a5-4bfb-bc63-c44391cbf6da tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 28799 microversion: 2.1 time: 0.086231 Oct 12 18:34:14.259365 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 543/1089] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:34:14 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 28799 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:34:14.273046 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-05db900a-4a41-4e25-a867-35273b3b32e1 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:14.273646 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-05db900a-4a41-4e25-a867-35273b3b32e1 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: c507ce79-0fb1-47d8-b6bf-9992f9d9484a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:14.282014 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-05db900a-4a41-4e25-a867-35273b3b32e1 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:14.282454 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-05db900a-4a41-4e25-a867-35273b3b32e1 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:14.283221 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-05db900a-4a41-4e25-a867-35273b3b32e1 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:14.283645 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-05db900a-4a41-4e25-a867-35273b3b32e1 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:14.297490 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.wsgi [None req-05db900a-4a41-4e25-a867-35273b3b32e1 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] HTTP exception thrown: Instance c507ce79-0fb1-47d8-b6bf-9992f9d9484a could not be found. Oct 12 18:34:14.298070 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-05db900a-4a41-4e25-a867-35273b3b32e1 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Returning 404 to user: Instance c507ce79-0fb1-47d8-b6bf-9992f9d9484a could not be found. {{(pid=109169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:34:14.298885 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-05db900a-4a41-4e25-a867-35273b3b32e1 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a" status: 404 len: 111 microversion: 2.1 time: 0.029429 Oct 12 18:34:14.299421 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 547/1090] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:34:14 2021] GET /compute/v2.1/servers/c507ce79-0fb1-47d8-b6bf-9992f9d9484a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:34:14.864769 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-fca294b7-eaae-4cc6-b3d7-687998495705 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:14.865453 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-fca294b7-eaae-4cc6-b3d7-687998495705 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:14.871742 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fca294b7-eaae-4cc6-b3d7-687998495705 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:14.884545 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fca294b7-eaae-4cc6-b3d7-687998495705 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:14.884545 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fca294b7-eaae-4cc6-b3d7-687998495705 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:14.884545 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fca294b7-eaae-4cc6-b3d7-687998495705 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:14.996002 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-fca294b7-eaae-4cc6-b3d7-687998495705 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:15.003620 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-fca294b7-eaae-4cc6-b3d7-687998495705 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:15.005136 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-fca294b7-eaae-4cc6-b3d7-687998495705 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:15.006297 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-fca294b7-eaae-4cc6-b3d7-687998495705 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1723 microversion: 2.20 time: 0.145597 Oct 12 18:34:15.006945 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 544/1091] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:14 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:15.270194 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-7612b359-4b72-40cc-ac9f-1d2b90f6f4b0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:15.271102 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-7612b359-4b72-40cc-ac9f-1d2b90f6f4b0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:15.277381 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7612b359-4b72-40cc-ac9f-1d2b90f6f4b0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:15.277937 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7612b359-4b72-40cc-ac9f-1d2b90f6f4b0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:15.278577 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7612b359-4b72-40cc-ac9f-1d2b90f6f4b0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:15.279008 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7612b359-4b72-40cc-ac9f-1d2b90f6f4b0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:15.352888 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-7612b359-4b72-40cc-ac9f-1d2b90f6f4b0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 30910 microversion: 2.1 time: 0.086153 Oct 12 18:34:15.353521 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 548/1092] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:34:15 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 30910 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:34:16.024472 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3b3d1265-3d19-4911-af07-e3c06d725231 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:16.025107 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3b3d1265-3d19-4911-af07-e3c06d725231 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:16.031535 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3b3d1265-3d19-4911-af07-e3c06d725231 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:16.031981 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3b3d1265-3d19-4911-af07-e3c06d725231 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:16.032758 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3b3d1265-3d19-4911-af07-e3c06d725231 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:16.033193 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3b3d1265-3d19-4911-af07-e3c06d725231 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:16.157721 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3b3d1265-3d19-4911-af07-e3c06d725231 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:16.165650 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3b3d1265-3d19-4911-af07-e3c06d725231 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:16.167147 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3b3d1265-3d19-4911-af07-e3c06d725231 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:16.168307 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3b3d1265-3d19-4911-af07-e3c06d725231 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1723 microversion: 2.20 time: 0.147577 Oct 12 18:34:16.168913 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 545/1093] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:16 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:16.365419 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-57064d22-54a1-4f34-851c-2cbd5597c152 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:16.366324 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-57064d22-54a1-4f34-851c-2cbd5597c152 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:16.372875 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-57064d22-54a1-4f34-851c-2cbd5597c152 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:16.373973 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-57064d22-54a1-4f34-851c-2cbd5597c152 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:16.374669 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-57064d22-54a1-4f34-851c-2cbd5597c152 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:16.375099 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-57064d22-54a1-4f34-851c-2cbd5597c152 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:17.186987 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c826ec08-5281-42b7-a1ed-3bbbb413192b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:17.187579 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c826ec08-5281-42b7-a1ed-3bbbb413192b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:17.193521 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c826ec08-5281-42b7-a1ed-3bbbb413192b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:17.193961 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c826ec08-5281-42b7-a1ed-3bbbb413192b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:17.194715 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c826ec08-5281-42b7-a1ed-3bbbb413192b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:17.195139 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c826ec08-5281-42b7-a1ed-3bbbb413192b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:17.314126 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c826ec08-5281-42b7-a1ed-3bbbb413192b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:17.321713 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c826ec08-5281-42b7-a1ed-3bbbb413192b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:17.323184 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c826ec08-5281-42b7-a1ed-3bbbb413192b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:17.324315 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c826ec08-5281-42b7-a1ed-3bbbb413192b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1723 microversion: 2.20 time: 0.141826 Oct 12 18:34:17.324889 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 546/1094] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:17 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1723 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:34:18.343218 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2be7c45b-7a0f-4955-b84f-14b9b759bf9a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:18.343933 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2be7c45b-7a0f-4955-b84f-14b9b759bf9a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:18.350573 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2be7c45b-7a0f-4955-b84f-14b9b759bf9a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:18.351020 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2be7c45b-7a0f-4955-b84f-14b9b759bf9a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:18.351839 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2be7c45b-7a0f-4955-b84f-14b9b759bf9a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:18.352264 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2be7c45b-7a0f-4955-b84f-14b9b759bf9a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:18.478753 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2be7c45b-7a0f-4955-b84f-14b9b759bf9a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:18.487142 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2be7c45b-7a0f-4955-b84f-14b9b759bf9a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:18.488749 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2be7c45b-7a0f-4955-b84f-14b9b759bf9a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:18.489893 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2be7c45b-7a0f-4955-b84f-14b9b759bf9a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1723 microversion: 2.20 time: 0.151307 Oct 12 18:34:18.490440 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 547/1095] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:18 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:34:18.852915 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-57064d22-54a1-4f34-851c-2cbd5597c152 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 34619 microversion: 2.1 time: 2.491393 Oct 12 18:34:18.853994 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 549/1096] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:34:16 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 34619 bytes in 2493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:34:19.508027 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e73f1a3b-d0fb-4f37-9285-e6f564e55177 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:19.508721 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e73f1a3b-d0fb-4f37-9285-e6f564e55177 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:19.514753 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e73f1a3b-d0fb-4f37-9285-e6f564e55177 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:19.515200 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e73f1a3b-d0fb-4f37-9285-e6f564e55177 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:19.515968 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e73f1a3b-d0fb-4f37-9285-e6f564e55177 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:19.516417 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e73f1a3b-d0fb-4f37-9285-e6f564e55177 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:19.637239 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e73f1a3b-d0fb-4f37-9285-e6f564e55177 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:19.644900 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e73f1a3b-d0fb-4f37-9285-e6f564e55177 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:19.646407 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e73f1a3b-d0fb-4f37-9285-e6f564e55177 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:19.647553 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e73f1a3b-d0fb-4f37-9285-e6f564e55177 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1723 microversion: 2.20 time: 0.143191 Oct 12 18:34:19.648117 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 548/1097] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:19 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1723 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:19.865779 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-dd5fddf6-4a36-46a0-9a46-5881272f353d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:19.866778 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-dd5fddf6-4a36-46a0-9a46-5881272f353d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:19.876153 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-dd5fddf6-4a36-46a0-9a46-5881272f353d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:19.876153 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-dd5fddf6-4a36-46a0-9a46-5881272f353d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:19.876153 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-dd5fddf6-4a36-46a0-9a46-5881272f353d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:19.876153 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-dd5fddf6-4a36-46a0-9a46-5881272f353d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:19.966377 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-dd5fddf6-4a36-46a0-9a46-5881272f353d tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 35813 microversion: 2.1 time: 0.104265 Oct 12 18:34:19.966922 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 550/1098] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:34:19 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 35813 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:34:20.666509 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4e81935c-7734-46e6-a19d-13b972ee5181 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:20.667139 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4e81935c-7734-46e6-a19d-13b972ee5181 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:20.673129 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4e81935c-7734-46e6-a19d-13b972ee5181 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:20.673571 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4e81935c-7734-46e6-a19d-13b972ee5181 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:20.674358 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4e81935c-7734-46e6-a19d-13b972ee5181 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:20.674865 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4e81935c-7734-46e6-a19d-13b972ee5181 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:20.816062 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4e81935c-7734-46e6-a19d-13b972ee5181 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:20.828151 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4e81935c-7734-46e6-a19d-13b972ee5181 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:20.829672 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4e81935c-7734-46e6-a19d-13b972ee5181 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:20.830833 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4e81935c-7734-46e6-a19d-13b972ee5181 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1723 microversion: 2.20 time: 0.168109 Oct 12 18:34:20.831384 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 549/1099] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:20 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:20.980697 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-bebec8a3-cc10-48b0-894b-90876a834fbb tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:20.981689 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-bebec8a3-cc10-48b0-894b-90876a834fbb tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:20.988164 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bebec8a3-cc10-48b0-894b-90876a834fbb tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:20.988659 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bebec8a3-cc10-48b0-894b-90876a834fbb tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:20.989420 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bebec8a3-cc10-48b0-894b-90876a834fbb tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:20.989849 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bebec8a3-cc10-48b0-894b-90876a834fbb tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:21.063990 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-bebec8a3-cc10-48b0-894b-90876a834fbb tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 37062 microversion: 2.1 time: 0.087115 Oct 12 18:34:21.064660 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 551/1100] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:34:20 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 37062 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:34:21.848006 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c1492d22-6a7e-44f7-b53c-6c9ea0c37706 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:21.848633 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c1492d22-6a7e-44f7-b53c-6c9ea0c37706 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:21.854441 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c1492d22-6a7e-44f7-b53c-6c9ea0c37706 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:21.854881 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c1492d22-6a7e-44f7-b53c-6c9ea0c37706 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:21.859469 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c1492d22-6a7e-44f7-b53c-6c9ea0c37706 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:21.859469 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c1492d22-6a7e-44f7-b53c-6c9ea0c37706 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:21.983116 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c1492d22-6a7e-44f7-b53c-6c9ea0c37706 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:21.991111 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c1492d22-6a7e-44f7-b53c-6c9ea0c37706 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:21.992635 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c1492d22-6a7e-44f7-b53c-6c9ea0c37706 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:21.993822 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c1492d22-6a7e-44f7-b53c-6c9ea0c37706 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1723 microversion: 2.20 time: 0.149636 Oct 12 18:34:21.994373 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 550/1101] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:21 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:22.077632 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-ccd31b25-754d-455e-8cc1-bda6df9d9076 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:22.078204 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-ccd31b25-754d-455e-8cc1-bda6df9d9076 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:22.084672 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ccd31b25-754d-455e-8cc1-bda6df9d9076 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:22.085112 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ccd31b25-754d-455e-8cc1-bda6df9d9076 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:22.085885 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ccd31b25-754d-455e-8cc1-bda6df9d9076 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:22.086309 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ccd31b25-754d-455e-8cc1-bda6df9d9076 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:22.333224 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-ccd31b25-754d-455e-8cc1-bda6df9d9076 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 38182 microversion: 2.1 time: 0.260996 Oct 12 18:34:22.333867 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 552/1102] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:34:22 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 38182 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:34:23.012253 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-20109194-4c1d-462f-a9a3-1ed4d79b02ce tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:23.012884 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-20109194-4c1d-462f-a9a3-1ed4d79b02ce tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:23.020036 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-20109194-4c1d-462f-a9a3-1ed4d79b02ce tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:23.020499 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-20109194-4c1d-462f-a9a3-1ed4d79b02ce tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:23.021261 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-20109194-4c1d-462f-a9a3-1ed4d79b02ce tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:23.021683 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-20109194-4c1d-462f-a9a3-1ed4d79b02ce tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:23.142528 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-20109194-4c1d-462f-a9a3-1ed4d79b02ce tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:23.150205 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-20109194-4c1d-462f-a9a3-1ed4d79b02ce tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:23.151678 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-20109194-4c1d-462f-a9a3-1ed4d79b02ce tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:23.152839 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-20109194-4c1d-462f-a9a3-1ed4d79b02ce tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1723 microversion: 2.20 time: 0.144195 Oct 12 18:34:23.153391 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 551/1103] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:23 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:23.346043 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-d9e09ad2-9641-4e85-9a97-1a7c64b89880 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:23.346994 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-d9e09ad2-9641-4e85-9a97-1a7c64b89880 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:23.353342 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d9e09ad2-9641-4e85-9a97-1a7c64b89880 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:23.353779 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d9e09ad2-9641-4e85-9a97-1a7c64b89880 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:23.354533 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d9e09ad2-9641-4e85-9a97-1a7c64b89880 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:23.354963 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d9e09ad2-9641-4e85-9a97-1a7c64b89880 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:24.172042 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2f67dbff-090e-4970-905d-67ddeb49d70d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:24.172667 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2f67dbff-090e-4970-905d-67ddeb49d70d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:24.178457 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2f67dbff-090e-4970-905d-67ddeb49d70d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:24.178903 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2f67dbff-090e-4970-905d-67ddeb49d70d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:24.179666 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2f67dbff-090e-4970-905d-67ddeb49d70d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:24.180099 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2f67dbff-090e-4970-905d-67ddeb49d70d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:24.299796 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2f67dbff-090e-4970-905d-67ddeb49d70d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:24.307554 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2f67dbff-090e-4970-905d-67ddeb49d70d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:24.309084 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2f67dbff-090e-4970-905d-67ddeb49d70d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:24.310236 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2f67dbff-090e-4970-905d-67ddeb49d70d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1723 microversion: 2.20 time: 0.141914 Oct 12 18:34:24.310791 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 552/1104] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:24 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1723 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:34:24.448712 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-d9e09ad2-9641-4e85-9a97-1a7c64b89880 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 38182 microversion: 2.1 time: 1.106942 Oct 12 18:34:24.449291 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 553/1105] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:34:23 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 38182 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:34:25.328866 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e3b4a6f1-9f89-4d69-8f8b-c0022af8c3e4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:25.329476 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e3b4a6f1-9f89-4d69-8f8b-c0022af8c3e4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:25.335881 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e3b4a6f1-9f89-4d69-8f8b-c0022af8c3e4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:25.336327 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e3b4a6f1-9f89-4d69-8f8b-c0022af8c3e4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:25.337130 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e3b4a6f1-9f89-4d69-8f8b-c0022af8c3e4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:25.337567 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e3b4a6f1-9f89-4d69-8f8b-c0022af8c3e4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:25.461804 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e3b4a6f1-9f89-4d69-8f8b-c0022af8c3e4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:25.467123 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-733d7f4a-a61b-4c01-b997-483efc7c550b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:25.468745 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-733d7f4a-a61b-4c01-b997-483efc7c550b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:25.470233 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e3b4a6f1-9f89-4d69-8f8b-c0022af8c3e4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:25.471734 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e3b4a6f1-9f89-4d69-8f8b-c0022af8c3e4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:25.472926 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e3b4a6f1-9f89-4d69-8f8b-c0022af8c3e4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1723 microversion: 2.20 time: 0.148433 Oct 12 18:34:25.473493 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 553/1106] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:25 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:25.475465 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-733d7f4a-a61b-4c01-b997-483efc7c550b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:25.475910 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-733d7f4a-a61b-4c01-b997-483efc7c550b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:25.476712 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-733d7f4a-a61b-4c01-b997-483efc7c550b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:25.477145 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-733d7f4a-a61b-4c01-b997-483efc7c550b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:26.006812 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-733d7f4a-a61b-4c01-b997-483efc7c550b tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 38182 microversion: 2.1 time: 0.549021 Oct 12 18:34:26.007631 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 554/1107] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:34:25 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 38182 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:34:26.491092 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e4de8d7d-ca05-4053-939c-96c1fde272d7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:26.491727 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e4de8d7d-ca05-4053-939c-96c1fde272d7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:26.497488 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e4de8d7d-ca05-4053-939c-96c1fde272d7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:26.497932 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e4de8d7d-ca05-4053-939c-96c1fde272d7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:26.498709 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e4de8d7d-ca05-4053-939c-96c1fde272d7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:26.499175 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e4de8d7d-ca05-4053-939c-96c1fde272d7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:26.626519 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e4de8d7d-ca05-4053-939c-96c1fde272d7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:26.634451 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e4de8d7d-ca05-4053-939c-96c1fde272d7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:26.635932 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e4de8d7d-ca05-4053-939c-96c1fde272d7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:26.637169 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e4de8d7d-ca05-4053-939c-96c1fde272d7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1723 microversion: 2.20 time: 0.149767 Oct 12 18:34:26.637700 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 554/1108] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:26 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:26.849123 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-e5f489b1-791c-4c8b-a7b7-a21de4a0a340 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1261961505", "imageRef": "c79f0511-74c5-46f3-a7e6-cde6b09234ee", "flavorRef": "452", "networks": [{"uuid": "2e0b2b7e-810d-4085-a3e3-d8a60d0397cb"}]}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:26.902058 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.network.neutron [None req-e5f489b1-791c-4c8b-a7b7-a21de4a0a340 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] validate_networks() for [('2e0b2b7e-810d-4085-a3e3-d8a60d0397cb', None, None, None, None, None)] {{(pid=109169) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 18:34:27.019202 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-58ff85a7-3f4f-4b58-b8ec-ebfaea6f4cc0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:27.020105 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-58ff85a7-3f4f-4b58-b8ec-ebfaea6f4cc0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:27.025973 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-58ff85a7-3f4f-4b58-b8ec-ebfaea6f4cc0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:27.026445 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-58ff85a7-3f4f-4b58-b8ec-ebfaea6f4cc0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:27.027226 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-58ff85a7-3f4f-4b58-b8ec-ebfaea6f4cc0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:27.027652 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-58ff85a7-3f4f-4b58-b8ec-ebfaea6f4cc0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:27.242724 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-e5f489b1-791c-4c8b-a7b7-a21de4a0a340 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Flavor limits 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 18:34:27.243138 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-e5f489b1-791c-4c8b-a7b7-a21de4a0a340 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Image limits 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 18:34:27.243606 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-e5f489b1-791c-4c8b-a7b7-a21de4a0a340 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Flavor pref 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 18:34:27.244036 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-e5f489b1-791c-4c8b-a7b7-a21de4a0a340 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Image pref 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 18:34:27.244462 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-e5f489b1-791c-4c8b-a7b7-a21de4a0a340 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 18:34:27.253525 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e5f489b1-791c-4c8b-a7b7-a21de4a0a340 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:27.254130 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e5f489b1-791c-4c8b-a7b7-a21de4a0a340 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:27.254944 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e5f489b1-791c-4c8b-a7b7-a21de4a0a340 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:27.255374 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e5f489b1-791c-4c8b-a7b7-a21de4a0a340 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:27.271665 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.quota [None req-e5f489b1-791c-4c8b-a7b7-a21de4a0a340 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Getting quotas for project 4ec087a3edc444cbb249442bb987326c. Resources: {'instances', 'cores', 'ram'} {{(pid=109169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:34:27.275514 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.quota [None req-e5f489b1-791c-4c8b-a7b7-a21de4a0a340 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Getting quotas for user eaaa8dff1ca444f081caa0cd1b4be6a9 and project 4ec087a3edc444cbb249442bb987326c. Resources: {'instances', 'cores', 'ram'} {{(pid=109169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:34:27.286210 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-e5f489b1-791c-4c8b-a7b7-a21de4a0a340 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Going to run 1 instances... {{(pid=109169) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 18:34:27.288912 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-e5f489b1-791c-4c8b-a7b7-a21de4a0a340 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: 220439aa-4c2e-48cd-8704-e6bc6f3e9ebf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c79f0511-74c5-46f3-a7e6-cde6b09234ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109169) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 18:34:27.391383 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-58ff85a7-3f4f-4b58-b8ec-ebfaea6f4cc0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 38182 microversion: 2.1 time: 0.375671 Oct 12 18:34:27.392426 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 555/1109] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:34:27 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 38182 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 18:34:27.422159 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-e5f489b1-791c-4c8b-a7b7-a21de4a0a340 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.576983 Oct 12 18:34:27.422803 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 555/1110] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Oct 12 18:34:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 18:34:27.432971 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a0bffd06-868d-4415-9069-2e5cd1104500 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:27.433670 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a0bffd06-868d-4415-9069-2e5cd1104500 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: 220439aa-4c2e-48cd-8704-e6bc6f3e9ebf] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:27.487739 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a0bffd06-868d-4415-9069-2e5cd1104500 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:27.494328 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a0bffd06-868d-4415-9069-2e5cd1104500 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf" status: 200 len: 1219 microversion: 2.1 time: 0.065256 Oct 12 18:34:27.494935 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 556/1111] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:34:27 2021] GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:34:27.664508 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-fe9bcfe8-aa76-426e-9c24-db6ce3769bc5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:27.665030 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-fe9bcfe8-aa76-426e-9c24-db6ce3769bc5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:27.672051 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fe9bcfe8-aa76-426e-9c24-db6ce3769bc5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:27.672516 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fe9bcfe8-aa76-426e-9c24-db6ce3769bc5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:27.673286 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fe9bcfe8-aa76-426e-9c24-db6ce3769bc5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:27.673707 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-fe9bcfe8-aa76-426e-9c24-db6ce3769bc5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:27.802082 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-fe9bcfe8-aa76-426e-9c24-db6ce3769bc5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:27.811936 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-fe9bcfe8-aa76-426e-9c24-db6ce3769bc5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:27.813466 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-fe9bcfe8-aa76-426e-9c24-db6ce3769bc5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:27.814631 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-fe9bcfe8-aa76-426e-9c24-db6ce3769bc5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1744 microversion: 2.20 time: 0.154138 Oct 12 18:34:27.815260 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 556/1112] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:27 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:28.403538 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-be272d5e-4b51-4518-bdaf-c3ffde139483 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:28.404736 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-be272d5e-4b51-4518-bdaf-c3ffde139483 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:28.412160 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-be272d5e-4b51-4518-bdaf-c3ffde139483 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:28.412659 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-be272d5e-4b51-4518-bdaf-c3ffde139483 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:28.413431 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-be272d5e-4b51-4518-bdaf-c3ffde139483 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:28.413858 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-be272d5e-4b51-4518-bdaf-c3ffde139483 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:28.511578 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-b42be404-abb8-4bc5-b13b-dfe5cb2fd946 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:28.512858 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-b42be404-abb8-4bc5-b13b-dfe5cb2fd946 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: 220439aa-4c2e-48cd-8704-e6bc6f3e9ebf] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:28.522077 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-be272d5e-4b51-4518-bdaf-c3ffde139483 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action" status: 200 len: 38313 microversion: 2.1 time: 0.121696 Oct 12 18:34:28.523282 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b42be404-abb8-4bc5-b13b-dfe5cb2fd946 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:28.523995 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b42be404-abb8-4bc5-b13b-dfe5cb2fd946 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:28.525382 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b42be404-abb8-4bc5-b13b-dfe5cb2fd946 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:28.526125 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b42be404-abb8-4bc5-b13b-dfe5cb2fd946 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:28.539535 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 557/1113] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:34:28 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/action => generated 38313 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:34:28.543452 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-fdbebbbd-9b11-47f2-ab67-d8927104eaf8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:28.544052 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-fdbebbbd-9b11-47f2-ab67-d8927104eaf8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:28.550781 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fdbebbbd-9b11-47f2-ab67-d8927104eaf8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:28.551225 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fdbebbbd-9b11-47f2-ab67-d8927104eaf8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:28.552077 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fdbebbbd-9b11-47f2-ab67-d8927104eaf8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:28.552536 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fdbebbbd-9b11-47f2-ab67-d8927104eaf8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:28.576716 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-fdbebbbd-9b11-47f2-ab67-d8927104eaf8 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/ips" status: 200 len: 145 microversion: 2.1 time: 0.037076 Oct 12 18:34:28.577310 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 558/1114] 10.222.0.18 () {58 vars in 1247 bytes} [Tue Oct 12 18:34:28 2021] GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 18:34:28.598683 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-b42be404-abb8-4bc5-b13b-dfe5cb2fd946 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:28.602887 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-b42be404-abb8-4bc5-b13b-dfe5cb2fd946 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf" status: 200 len: 1223 microversion: 2.1 time: 0.094922 Oct 12 18:34:28.603466 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 557/1115] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:34:28 2021] GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:34:28.836178 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ed414240-c4c3-446f-82b0-92a4160f4252 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:28.836739 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ed414240-c4c3-446f-82b0-92a4160f4252 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:28.842462 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ed414240-c4c3-446f-82b0-92a4160f4252 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:28.842903 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ed414240-c4c3-446f-82b0-92a4160f4252 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:28.843696 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ed414240-c4c3-446f-82b0-92a4160f4252 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:28.844123 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ed414240-c4c3-446f-82b0-92a4160f4252 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:28.982223 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ed414240-c4c3-446f-82b0-92a4160f4252 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:28.991292 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ed414240-c4c3-446f-82b0-92a4160f4252 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:28.992933 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ed414240-c4c3-446f-82b0-92a4160f4252 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:28.994225 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ed414240-c4c3-446f-82b0-92a4160f4252 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1744 microversion: 2.20 time: 0.161865 Oct 12 18:34:28.998032 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 559/1116] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:28 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:29.619413 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-1a5c1be3-6729-44e5-859f-b1e6e674b643 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:29.620066 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-1a5c1be3-6729-44e5-859f-b1e6e674b643 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: 220439aa-4c2e-48cd-8704-e6bc6f3e9ebf] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:29.626004 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1a5c1be3-6729-44e5-859f-b1e6e674b643 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:29.626446 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1a5c1be3-6729-44e5-859f-b1e6e674b643 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:29.627227 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1a5c1be3-6729-44e5-859f-b1e6e674b643 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:29.627658 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1a5c1be3-6729-44e5-859f-b1e6e674b643 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:29.687802 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-1a5c1be3-6729-44e5-859f-b1e6e674b643 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:29.695287 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-1a5c1be3-6729-44e5-859f-b1e6e674b643 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf" status: 200 len: 1289 microversion: 2.1 time: 0.079574 Oct 12 18:34:29.695863 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 558/1117] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:34:29 2021] GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf => generated 1289 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:34:30.013344 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a1d99bd5-8250-485e-9153-4955bc5185d7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:30.014065 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a1d99bd5-8250-485e-9153-4955bc5185d7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:30.021531 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a1d99bd5-8250-485e-9153-4955bc5185d7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:30.026331 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a1d99bd5-8250-485e-9153-4955bc5185d7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:30.026331 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a1d99bd5-8250-485e-9153-4955bc5185d7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:30.026331 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a1d99bd5-8250-485e-9153-4955bc5185d7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:30.187000 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-1b1350f7-ba81-402e-af2c-597461117da5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d43ef8a1-e005-44f2-b09f-3bf5c284e285"}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:30.188100 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-1b1350f7-ba81-402e-af2c-597461117da5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:30.194027 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1b1350f7-ba81-402e-af2c-597461117da5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:30.194463 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1b1350f7-ba81-402e-af2c-597461117da5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:30.195230 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1b1350f7-ba81-402e-af2c-597461117da5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:30.195658 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1b1350f7-ba81-402e-af2c-597461117da5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:30.255095 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a1d99bd5-8250-485e-9153-4955bc5185d7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:30.265736 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a1d99bd5-8250-485e-9153-4955bc5185d7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:30.267495 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a1d99bd5-8250-485e-9153-4955bc5185d7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:30.269173 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a1d99bd5-8250-485e-9153-4955bc5185d7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1744 microversion: 2.20 time: 0.259834 Oct 12 18:34:30.269940 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 560/1118] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:30 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1744 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:30.712920 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-415dbbac-00cd-4de2-b545-cb66f96ee48c tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:30.717002 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-415dbbac-00cd-4de2-b545-cb66f96ee48c tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: 220439aa-4c2e-48cd-8704-e6bc6f3e9ebf] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:30.721589 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-415dbbac-00cd-4de2-b545-cb66f96ee48c tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:30.722034 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-415dbbac-00cd-4de2-b545-cb66f96ee48c tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:30.722807 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-415dbbac-00cd-4de2-b545-cb66f96ee48c tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:30.723240 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-415dbbac-00cd-4de2-b545-cb66f96ee48c tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:30.898201 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-415dbbac-00cd-4de2-b545-cb66f96ee48c tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:30.911022 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-415dbbac-00cd-4de2-b545-cb66f96ee48c tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf" status: 200 len: 1319 microversion: 2.1 time: 0.201663 Oct 12 18:34:30.917790 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 561/1119] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:34:30 2021] GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:34:30.961712 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-1b1350f7-ba81-402e-af2c-597461117da5 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.778728 Oct 12 18:34:30.966711 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 559/1120] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Oct 12 18:34:30 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/os-volume_attachments => generated 194 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 18:34:31.197886 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-ff76fe21-3aea-4ef7-854a-f6070f74f18d req-3d435d31-d01f-4889-bc05-72eba4715382 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "220439aa-4c2e-48cd-8704-e6bc6f3e9ebf", "tag": "0452dd24-8e0a-42a0-80df-409da03aecd6"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:31.199508 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:34:31.199508 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:34:31.207048 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-ff76fe21-3aea-4ef7-854a-f6070f74f18d req-3d435d31-d01f-4889-bc05-72eba4715382 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:31.207568 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-ff76fe21-3aea-4ef7-854a-f6070f74f18d req-3d435d31-d01f-4889-bc05-72eba4715382 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:31.219937 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-ff76fe21-3aea-4ef7-854a-f6070f74f18d req-3d435d31-d01f-4889-bc05-72eba4715382 service nova] Creating event network-changed:0452dd24-8e0a-42a0-80df-409da03aecd6 for instance 220439aa-4c2e-48cd-8704-e6bc6f3e9ebf on hv-cinder-81322 Oct 12 18:34:31.224279 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-ff76fe21-3aea-4ef7-854a-f6070f74f18d req-3d435d31-d01f-4889-bc05-72eba4715382 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030138 Oct 12 18:34:31.225119 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 562/1121] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:34:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:34:31.289092 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-7155d156-af43-4f90-9e32-9269f8751fcc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:31.289791 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-7155d156-af43-4f90-9e32-9269f8751fcc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:31.299213 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7155d156-af43-4f90-9e32-9269f8751fcc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:31.299656 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7155d156-af43-4f90-9e32-9269f8751fcc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:31.300453 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7155d156-af43-4f90-9e32-9269f8751fcc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:31.300885 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7155d156-af43-4f90-9e32-9269f8751fcc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:31.766453 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-7155d156-af43-4f90-9e32-9269f8751fcc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:31.774386 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-7155d156-af43-4f90-9e32-9269f8751fcc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:31.775861 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-7155d156-af43-4f90-9e32-9269f8751fcc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:31.777118 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-7155d156-af43-4f90-9e32-9269f8751fcc tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1744 microversion: 2.20 time: 0.492644 Oct 12 18:34:31.777681 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 560/1122] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:31 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1744 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:31.929384 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-916ccae0-7216-4855-9dbf-28274a3a76b5 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:31.930081 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-916ccae0-7216-4855-9dbf-28274a3a76b5 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: 220439aa-4c2e-48cd-8704-e6bc6f3e9ebf] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:31.936833 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-916ccae0-7216-4855-9dbf-28274a3a76b5 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:31.937409 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-916ccae0-7216-4855-9dbf-28274a3a76b5 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:31.938216 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-916ccae0-7216-4855-9dbf-28274a3a76b5 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:31.938661 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-916ccae0-7216-4855-9dbf-28274a3a76b5 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:32.165157 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-916ccae0-7216-4855-9dbf-28274a3a76b5 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:32.173555 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-916ccae0-7216-4855-9dbf-28274a3a76b5 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf" status: 200 len: 1319 microversion: 2.1 time: 0.248176 Oct 12 18:34:32.174137 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 563/1123] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:34:31 2021] GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:34:32.319251 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-e15a00fb-1e46-4f7d-9b6f-a958b0e735e3 req-59fd1344-fd82-44a7-9d11-7934a3e7b746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a73458df-c845-4c48-9839-58d3acdfd4da", "name": "network-vif-plugged", "status": "completed", "tag": "6b4b7683-8980-4bd3-9e9f-66f9276cb054"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:32.320833 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:34:32.320833 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:34:32.327975 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-e15a00fb-1e46-4f7d-9b6f-a958b0e735e3 req-59fd1344-fd82-44a7-9d11-7934a3e7b746 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:32.328421 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-e15a00fb-1e46-4f7d-9b6f-a958b0e735e3 req-59fd1344-fd82-44a7-9d11-7934a3e7b746 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:32.339434 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-e15a00fb-1e46-4f7d-9b6f-a958b0e735e3 req-59fd1344-fd82-44a7-9d11-7934a3e7b746 service nova] Creating event network-vif-plugged:6b4b7683-8980-4bd3-9e9f-66f9276cb054 for instance a73458df-c845-4c48-9839-58d3acdfd4da on hv-cinder-81322 Oct 12 18:34:32.344875 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-e15a00fb-1e46-4f7d-9b6f-a958b0e735e3 req-59fd1344-fd82-44a7-9d11-7934a3e7b746 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029206 Oct 12 18:34:32.345527 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 561/1124] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:34:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:34:32.796821 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d0ed055f-0ce5-4621-ae77-151802f3e230 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:32.797427 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d0ed055f-0ce5-4621-ae77-151802f3e230 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:32.803188 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d0ed055f-0ce5-4621-ae77-151802f3e230 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:32.809593 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d0ed055f-0ce5-4621-ae77-151802f3e230 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:32.809593 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d0ed055f-0ce5-4621-ae77-151802f3e230 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:32.809593 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d0ed055f-0ce5-4621-ae77-151802f3e230 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:32.932423 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d0ed055f-0ce5-4621-ae77-151802f3e230 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:32.940990 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d0ed055f-0ce5-4621-ae77-151802f3e230 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:32.942496 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d0ed055f-0ce5-4621-ae77-151802f3e230 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:32.943662 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d0ed055f-0ce5-4621-ae77-151802f3e230 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1744 microversion: 2.20 time: 0.151136 Oct 12 18:34:32.944217 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 564/1125] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:32 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:33.191009 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-092dbcef-490b-4bd4-a13f-62b3bf77cd72 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:33.191696 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-092dbcef-490b-4bd4-a13f-62b3bf77cd72 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: 220439aa-4c2e-48cd-8704-e6bc6f3e9ebf] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:33.197908 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-092dbcef-490b-4bd4-a13f-62b3bf77cd72 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:33.198358 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-092dbcef-490b-4bd4-a13f-62b3bf77cd72 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:33.199122 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-092dbcef-490b-4bd4-a13f-62b3bf77cd72 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:33.199551 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-092dbcef-490b-4bd4-a13f-62b3bf77cd72 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:33.329447 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-092dbcef-490b-4bd4-a13f-62b3bf77cd72 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:33.337062 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-092dbcef-490b-4bd4-a13f-62b3bf77cd72 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf" status: 200 len: 1319 microversion: 2.1 time: 0.150031 Oct 12 18:34:33.337632 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 562/1126] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:34:33 2021] GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:34:33.960982 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-79e57c1e-326a-43a7-aa1a-477ddecaa22d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:33.961558 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-79e57c1e-326a-43a7-aa1a-477ddecaa22d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:33.967788 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-79e57c1e-326a-43a7-aa1a-477ddecaa22d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:33.968236 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-79e57c1e-326a-43a7-aa1a-477ddecaa22d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:33.969028 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-79e57c1e-326a-43a7-aa1a-477ddecaa22d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:33.969459 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-79e57c1e-326a-43a7-aa1a-477ddecaa22d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:34.087356 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-79e57c1e-326a-43a7-aa1a-477ddecaa22d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:34.095434 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-79e57c1e-326a-43a7-aa1a-477ddecaa22d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:34.096951 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-79e57c1e-326a-43a7-aa1a-477ddecaa22d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:34.098099 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-79e57c1e-326a-43a7-aa1a-477ddecaa22d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1744 microversion: 2.20 time: 0.140924 Oct 12 18:34:34.098658 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 565/1127] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:33 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1744 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:34:34.353468 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-d31e6084-93d8-4fd2-ab32-d527f6b415f5 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:34.354072 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-d31e6084-93d8-4fd2-ab32-d527f6b415f5 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: 220439aa-4c2e-48cd-8704-e6bc6f3e9ebf] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:34.360447 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d31e6084-93d8-4fd2-ab32-d527f6b415f5 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:34.360898 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d31e6084-93d8-4fd2-ab32-d527f6b415f5 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:34.361676 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d31e6084-93d8-4fd2-ab32-d527f6b415f5 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:34.362106 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d31e6084-93d8-4fd2-ab32-d527f6b415f5 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:34.487990 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-d31e6084-93d8-4fd2-ab32-d527f6b415f5 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:34.495262 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-d31e6084-93d8-4fd2-ab32-d527f6b415f5 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf" status: 200 len: 1319 microversion: 2.1 time: 0.145498 Oct 12 18:34:34.495819 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 563/1128] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:34:34 2021] GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:34:35.117292 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a319535e-c00a-46eb-95dc-c3ea471d9b4d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:35.118013 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a319535e-c00a-46eb-95dc-c3ea471d9b4d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:35.123851 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a319535e-c00a-46eb-95dc-c3ea471d9b4d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:35.124286 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a319535e-c00a-46eb-95dc-c3ea471d9b4d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:35.125084 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a319535e-c00a-46eb-95dc-c3ea471d9b4d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:35.127333 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a319535e-c00a-46eb-95dc-c3ea471d9b4d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:35.257733 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a319535e-c00a-46eb-95dc-c3ea471d9b4d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:35.266268 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a319535e-c00a-46eb-95dc-c3ea471d9b4d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:35.268104 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a319535e-c00a-46eb-95dc-c3ea471d9b4d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:35.269281 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a319535e-c00a-46eb-95dc-c3ea471d9b4d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1739 microversion: 2.20 time: 0.156258 Oct 12 18:34:35.270282 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 566/1129] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:35 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:35.511356 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-d6459c8c-ba87-4f23-9842-730a75a1b89b tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:35.512534 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-d6459c8c-ba87-4f23-9842-730a75a1b89b tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: 220439aa-4c2e-48cd-8704-e6bc6f3e9ebf] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:35.518778 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d6459c8c-ba87-4f23-9842-730a75a1b89b tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:35.519215 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d6459c8c-ba87-4f23-9842-730a75a1b89b tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:35.519984 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d6459c8c-ba87-4f23-9842-730a75a1b89b tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:35.520418 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d6459c8c-ba87-4f23-9842-730a75a1b89b tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:35.650381 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-d6459c8c-ba87-4f23-9842-730a75a1b89b tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:35.658431 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-d6459c8c-ba87-4f23-9842-730a75a1b89b tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf" status: 200 len: 1319 microversion: 2.1 time: 0.150789 Oct 12 18:34:35.659005 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 564/1130] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:34:35 2021] GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:34:36.289167 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-497f67bb-689e-442f-858b-0cffb706ef9c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:36.289879 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-497f67bb-689e-442f-858b-0cffb706ef9c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:36.303366 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-497f67bb-689e-442f-858b-0cffb706ef9c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:36.303827 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-497f67bb-689e-442f-858b-0cffb706ef9c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:36.304812 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-497f67bb-689e-442f-858b-0cffb706ef9c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:36.305250 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-497f67bb-689e-442f-858b-0cffb706ef9c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:36.497302 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-497f67bb-689e-442f-858b-0cffb706ef9c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:36.510378 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-497f67bb-689e-442f-858b-0cffb706ef9c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:36.512146 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-497f67bb-689e-442f-858b-0cffb706ef9c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:36.513401 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-497f67bb-689e-442f-858b-0cffb706ef9c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1739 microversion: 2.20 time: 0.228322 Oct 12 18:34:36.514493 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 567/1131] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:36 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1739 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:36.677044 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-322b2621-c13a-44c4-b8ab-4513df0b0293 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:36.677622 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-322b2621-c13a-44c4-b8ab-4513df0b0293 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: 220439aa-4c2e-48cd-8704-e6bc6f3e9ebf] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:36.684386 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-322b2621-c13a-44c4-b8ab-4513df0b0293 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:36.684871 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-322b2621-c13a-44c4-b8ab-4513df0b0293 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:36.685643 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-322b2621-c13a-44c4-b8ab-4513df0b0293 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:36.686646 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-322b2621-c13a-44c4-b8ab-4513df0b0293 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:36.851929 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-322b2621-c13a-44c4-b8ab-4513df0b0293 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:36.859952 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-322b2621-c13a-44c4-b8ab-4513df0b0293 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf" status: 200 len: 1319 microversion: 2.1 time: 0.188155 Oct 12 18:34:36.874038 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 565/1132] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:34:36 2021] GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:34:37.533136 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2f2a5b36-dd19-4183-b971-93f89335950c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:37.533907 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2f2a5b36-dd19-4183-b971-93f89335950c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:37.540249 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2f2a5b36-dd19-4183-b971-93f89335950c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:37.540805 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2f2a5b36-dd19-4183-b971-93f89335950c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:37.541634 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2f2a5b36-dd19-4183-b971-93f89335950c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:37.542064 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2f2a5b36-dd19-4183-b971-93f89335950c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:37.676849 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2f2a5b36-dd19-4183-b971-93f89335950c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:37.687096 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2f2a5b36-dd19-4183-b971-93f89335950c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:37.688940 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2f2a5b36-dd19-4183-b971-93f89335950c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:37.690113 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2f2a5b36-dd19-4183-b971-93f89335950c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1739 microversion: 2.20 time: 0.161549 Oct 12 18:34:37.690709 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 568/1133] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:37 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:37.884225 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-af33bdfc-5381-4afa-b721-edb90b1b48ab tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:37.884820 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-af33bdfc-5381-4afa-b721-edb90b1b48ab tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: 220439aa-4c2e-48cd-8704-e6bc6f3e9ebf] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:37.891131 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-af33bdfc-5381-4afa-b721-edb90b1b48ab tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:37.891577 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-af33bdfc-5381-4afa-b721-edb90b1b48ab tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:37.892358 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-af33bdfc-5381-4afa-b721-edb90b1b48ab tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:37.892817 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-af33bdfc-5381-4afa-b721-edb90b1b48ab tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:38.057357 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-af33bdfc-5381-4afa-b721-edb90b1b48ab tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:38.066116 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-af33bdfc-5381-4afa-b721-edb90b1b48ab tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf" status: 200 len: 1319 microversion: 2.1 time: 0.187115 Oct 12 18:34:38.067352 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 566/1134] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:34:37 2021] GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:34:38.708725 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a44ea26f-c333-4c4f-9781-225aa2383ce6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:38.709849 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a44ea26f-c333-4c4f-9781-225aa2383ce6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:38.717539 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a44ea26f-c333-4c4f-9781-225aa2383ce6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:38.718504 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a44ea26f-c333-4c4f-9781-225aa2383ce6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:38.719568 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a44ea26f-c333-4c4f-9781-225aa2383ce6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:38.720217 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a44ea26f-c333-4c4f-9781-225aa2383ce6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:38.878561 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a44ea26f-c333-4c4f-9781-225aa2383ce6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:38.891726 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a44ea26f-c333-4c4f-9781-225aa2383ce6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:38.891726 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a44ea26f-c333-4c4f-9781-225aa2383ce6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:38.891726 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a44ea26f-c333-4c4f-9781-225aa2383ce6 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1739 microversion: 2.20 time: 0.186781 Oct 12 18:34:38.902430 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 569/1135] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:38 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:39.083056 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-dc1365d0-307a-415a-8b2c-98e18ae17831 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:39.083818 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-dc1365d0-307a-415a-8b2c-98e18ae17831 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: 220439aa-4c2e-48cd-8704-e6bc6f3e9ebf] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:39.091427 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-dc1365d0-307a-415a-8b2c-98e18ae17831 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:39.092535 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-dc1365d0-307a-415a-8b2c-98e18ae17831 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:39.093411 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-dc1365d0-307a-415a-8b2c-98e18ae17831 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:39.093918 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-dc1365d0-307a-415a-8b2c-98e18ae17831 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:39.233222 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-dc1365d0-307a-415a-8b2c-98e18ae17831 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:39.240639 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-dc1365d0-307a-415a-8b2c-98e18ae17831 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf" status: 200 len: 1319 microversion: 2.1 time: 0.161296 Oct 12 18:34:39.241210 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 567/1136] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:34:39 2021] GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:34:39.574109 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0fe75cf2-2531-4eb4-93c4-4243c9f0c24c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:39.578858 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0fe75cf2-2531-4eb4-93c4-4243c9f0c24c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:39.581368 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0fe75cf2-2531-4eb4-93c4-4243c9f0c24c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:39.581844 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0fe75cf2-2531-4eb4-93c4-4243c9f0c24c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:39.582608 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0fe75cf2-2531-4eb4-93c4-4243c9f0c24c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:39.583038 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0fe75cf2-2531-4eb4-93c4-4243c9f0c24c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:39.612833 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0fe75cf2-2531-4eb4-93c4-4243c9f0c24c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042392 Oct 12 18:34:39.613475 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 570/1137] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Oct 12 18:34:39 2021] GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:34:39.626317 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-0f430b2b-2fcf-4906-8d0c-577c05dfaf9c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:39.626843 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-0f430b2b-2fcf-4906-8d0c-577c05dfaf9c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:39.637818 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0f430b2b-2fcf-4906-8d0c-577c05dfaf9c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:39.638373 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0f430b2b-2fcf-4906-8d0c-577c05dfaf9c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:39.639859 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0f430b2b-2fcf-4906-8d0c-577c05dfaf9c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:39.640292 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0f430b2b-2fcf-4906-8d0c-577c05dfaf9c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:39.677030 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-0f430b2b-2fcf-4906-8d0c-577c05dfaf9c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/os-volume_attachments/d43ef8a1-e005-44f2-b09f-3bf5c284e285" status: 200 len: 194 microversion: 2.1 time: 0.054566 Oct 12 18:34:39.682827 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 568/1138] 10.222.0.18 () {58 vars in 1412 bytes} [Tue Oct 12 18:34:39 2021] GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/os-volume_attachments/d43ef8a1-e005-44f2-b09f-3bf5c284e285 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:34:39.910565 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ef9c9f04-5155-4c25-b3c2-ed861f6bc96d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:39.911873 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ef9c9f04-5155-4c25-b3c2-ed861f6bc96d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:39.922709 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ef9c9f04-5155-4c25-b3c2-ed861f6bc96d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:39.923993 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ef9c9f04-5155-4c25-b3c2-ed861f6bc96d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:39.925382 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ef9c9f04-5155-4c25-b3c2-ed861f6bc96d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:39.926041 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ef9c9f04-5155-4c25-b3c2-ed861f6bc96d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:40.081038 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ef9c9f04-5155-4c25-b3c2-ed861f6bc96d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:40.090620 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ef9c9f04-5155-4c25-b3c2-ed861f6bc96d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:40.093040 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ef9c9f04-5155-4c25-b3c2-ed861f6bc96d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:40.094659 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ef9c9f04-5155-4c25-b3c2-ed861f6bc96d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1739 microversion: 2.20 time: 0.187654 Oct 12 18:34:40.095273 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 571/1139] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:39 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:34:40.259893 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-88581b6c-7b9e-4aa2-ad60-14b35a78a378 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:40.260954 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-88581b6c-7b9e-4aa2-ad60-14b35a78a378 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: 220439aa-4c2e-48cd-8704-e6bc6f3e9ebf] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:40.268992 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-88581b6c-7b9e-4aa2-ad60-14b35a78a378 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:40.268992 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-88581b6c-7b9e-4aa2-ad60-14b35a78a378 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:40.269445 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-88581b6c-7b9e-4aa2-ad60-14b35a78a378 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:40.269851 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-88581b6c-7b9e-4aa2-ad60-14b35a78a378 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:40.439274 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-88581b6c-7b9e-4aa2-ad60-14b35a78a378 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:40.449691 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-88581b6c-7b9e-4aa2-ad60-14b35a78a378 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf" status: 200 len: 1319 microversion: 2.1 time: 0.193602 Oct 12 18:34:40.464191 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 569/1140] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:34:40 2021] GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:34:40.510660 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-33df695c-523b-44ff-8453-8028ce9db4fc req-4bf4691a-d769-4a76-af09-901811ac544d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "220439aa-4c2e-48cd-8704-e6bc6f3e9ebf", "name": "network-vif-plugged", "status": "completed", "tag": "0452dd24-8e0a-42a0-80df-409da03aecd6"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:40.510660 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:34:40.510660 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:34:40.520228 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-33df695c-523b-44ff-8453-8028ce9db4fc req-4bf4691a-d769-4a76-af09-901811ac544d service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:40.520632 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-33df695c-523b-44ff-8453-8028ce9db4fc req-4bf4691a-d769-4a76-af09-901811ac544d service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:40.532836 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-33df695c-523b-44ff-8453-8028ce9db4fc req-4bf4691a-d769-4a76-af09-901811ac544d service nova] Creating event network-vif-plugged:0452dd24-8e0a-42a0-80df-409da03aecd6 for instance 220439aa-4c2e-48cd-8704-e6bc6f3e9ebf on hv-cinder-81322 Oct 12 18:34:40.537896 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-33df695c-523b-44ff-8453-8028ce9db4fc req-4bf4691a-d769-4a76-af09-901811ac544d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036249 Oct 12 18:34:40.538972 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 572/1141] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:34:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:34:41.113918 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-18e9cc7d-f272-4ebd-872f-dbe3795de516 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:41.114614 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-18e9cc7d-f272-4ebd-872f-dbe3795de516 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:41.121467 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-18e9cc7d-f272-4ebd-872f-dbe3795de516 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:41.122041 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-18e9cc7d-f272-4ebd-872f-dbe3795de516 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:41.122891 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-18e9cc7d-f272-4ebd-872f-dbe3795de516 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:41.124260 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-18e9cc7d-f272-4ebd-872f-dbe3795de516 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:41.257852 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-18e9cc7d-f272-4ebd-872f-dbe3795de516 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:41.266061 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-18e9cc7d-f272-4ebd-872f-dbe3795de516 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:41.267603 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-18e9cc7d-f272-4ebd-872f-dbe3795de516 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:41.268821 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-18e9cc7d-f272-4ebd-872f-dbe3795de516 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1739 microversion: 2.20 time: 0.158869 Oct 12 18:34:41.269381 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 570/1142] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:41 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:41.467780 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d73ad431-404e-405d-8a31-1d2c95802410 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:41.469085 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d73ad431-404e-405d-8a31-1d2c95802410 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: 220439aa-4c2e-48cd-8704-e6bc6f3e9ebf] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:41.477620 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d73ad431-404e-405d-8a31-1d2c95802410 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:41.478079 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d73ad431-404e-405d-8a31-1d2c95802410 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:41.478898 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d73ad431-404e-405d-8a31-1d2c95802410 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:41.479515 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d73ad431-404e-405d-8a31-1d2c95802410 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:41.637055 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d73ad431-404e-405d-8a31-1d2c95802410 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:41.645767 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d73ad431-404e-405d-8a31-1d2c95802410 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf" status: 200 len: 1319 microversion: 2.1 time: 0.182045 Oct 12 18:34:41.646773 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 573/1143] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:34:41 2021] GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:34:42.288743 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-779f40c4-9003-46e0-a778-86612be8c41b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:42.289453 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-779f40c4-9003-46e0-a778-86612be8c41b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:42.296111 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-779f40c4-9003-46e0-a778-86612be8c41b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:42.296912 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-779f40c4-9003-46e0-a778-86612be8c41b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:42.297693 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-779f40c4-9003-46e0-a778-86612be8c41b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:42.298127 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-779f40c4-9003-46e0-a778-86612be8c41b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:42.426316 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-86513799-6c54-49b2-8869-275311a7be3f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0fe1c23b-a2ad-4e06-87c3-c04e5f5814a2"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:42.429936 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-86513799-6c54-49b2-8869-275311a7be3f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:42.437924 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-86513799-6c54-49b2-8869-275311a7be3f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:42.438532 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-86513799-6c54-49b2-8869-275311a7be3f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:42.439582 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-86513799-6c54-49b2-8869-275311a7be3f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:42.440078 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-86513799-6c54-49b2-8869-275311a7be3f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:42.505315 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-779f40c4-9003-46e0-a778-86612be8c41b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:42.526901 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-779f40c4-9003-46e0-a778-86612be8c41b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:42.530578 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-779f40c4-9003-46e0-a778-86612be8c41b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:42.533537 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-779f40c4-9003-46e0-a778-86612be8c41b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1739 microversion: 2.20 time: 0.247411 Oct 12 18:34:42.535829 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 571/1144] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:42 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1739 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:42.671330 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-5fb77888-f452-4c84-a3bc-4cc8bf5e8b22 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:42.673236 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-5fb77888-f452-4c84-a3bc-4cc8bf5e8b22 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: 220439aa-4c2e-48cd-8704-e6bc6f3e9ebf] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:42.681918 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5fb77888-f452-4c84-a3bc-4cc8bf5e8b22 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:42.682614 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5fb77888-f452-4c84-a3bc-4cc8bf5e8b22 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:42.683717 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5fb77888-f452-4c84-a3bc-4cc8bf5e8b22 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:42.684376 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5fb77888-f452-4c84-a3bc-4cc8bf5e8b22 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:42.843442 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-5fb77888-f452-4c84-a3bc-4cc8bf5e8b22 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:42.851461 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-5fb77888-f452-4c84-a3bc-4cc8bf5e8b22 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf" status: 200 len: 1319 microversion: 2.1 time: 0.188186 Oct 12 18:34:42.852377 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 572/1145] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:34:42 2021] GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:34:43.552863 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-50cca561-8d00-46c7-b6a3-5fe73279d17e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:43.554491 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-50cca561-8d00-46c7-b6a3-5fe73279d17e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:43.562314 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-50cca561-8d00-46c7-b6a3-5fe73279d17e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:43.562754 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-50cca561-8d00-46c7-b6a3-5fe73279d17e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:43.563517 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-50cca561-8d00-46c7-b6a3-5fe73279d17e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:43.568820 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-50cca561-8d00-46c7-b6a3-5fe73279d17e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:43.720817 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-50cca561-8d00-46c7-b6a3-5fe73279d17e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:43.730434 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-50cca561-8d00-46c7-b6a3-5fe73279d17e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:43.732332 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-50cca561-8d00-46c7-b6a3-5fe73279d17e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:43.733958 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-50cca561-8d00-46c7-b6a3-5fe73279d17e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1739 microversion: 2.20 time: 0.184949 Oct 12 18:34:43.734852 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 573/1146] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:43 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:43.775669 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-86513799-6c54-49b2-8869-275311a7be3f tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.357299 Oct 12 18:34:43.781697 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 574/1147] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Oct 12 18:34:42 2021] POST /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/os-volume_attachments => generated 194 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:34:43.868955 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c9f32e16-d880-4ce6-845f-9db2c8c593e0 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:43.869572 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c9f32e16-d880-4ce6-845f-9db2c8c593e0 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: 220439aa-4c2e-48cd-8704-e6bc6f3e9ebf] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:43.876125 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c9f32e16-d880-4ce6-845f-9db2c8c593e0 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:43.876613 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c9f32e16-d880-4ce6-845f-9db2c8c593e0 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:43.877404 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c9f32e16-d880-4ce6-845f-9db2c8c593e0 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:43.877841 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c9f32e16-d880-4ce6-845f-9db2c8c593e0 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:44.105169 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c9f32e16-d880-4ce6-845f-9db2c8c593e0 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:44.117980 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c9f32e16-d880-4ce6-845f-9db2c8c593e0 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf" status: 200 len: 1507 microversion: 2.1 time: 0.248933 Oct 12 18:34:44.118813 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 574/1148] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:34:43 2021] GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf => generated 1507 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:34:44.135802 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-12e7624c-f45f-4e2e-9953-b7241917c257 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ff5b881-6d77-4b7d-ae17-b0c514d362ce", "device": "/dev/sdb"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:44.138343 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-12e7624c-f45f-4e2e-9953-b7241917c257 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: 220439aa-4c2e-48cd-8704-e6bc6f3e9ebf] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:44.145624 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-12e7624c-f45f-4e2e-9953-b7241917c257 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:44.146350 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-12e7624c-f45f-4e2e-9953-b7241917c257 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:44.147324 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-12e7624c-f45f-4e2e-9953-b7241917c257 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:44.147942 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-12e7624c-f45f-4e2e-9953-b7241917c257 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:44.752974 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c8f8ea53-f4de-4333-bcf0-5ad0e6c147a9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:44.754196 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c8f8ea53-f4de-4333-bcf0-5ad0e6c147a9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:44.763233 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c8f8ea53-f4de-4333-bcf0-5ad0e6c147a9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:44.773044 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c8f8ea53-f4de-4333-bcf0-5ad0e6c147a9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:44.773044 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c8f8ea53-f4de-4333-bcf0-5ad0e6c147a9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:44.773468 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c8f8ea53-f4de-4333-bcf0-5ad0e6c147a9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:45.033902 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-12e7624c-f45f-4e2e-9953-b7241917c257 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "POST /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.901859 Oct 12 18:34:45.035298 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 575/1149] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Oct 12 18:34:44 2021] POST /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf/os-volume_attachments => generated 194 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:34:45.050498 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c8f8ea53-f4de-4333-bcf0-5ad0e6c147a9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:45.053638 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-97221b4d-2702-4a56-a6e7-ae00d5a507cd tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:45.054229 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-97221b4d-2702-4a56-a6e7-ae00d5a507cd tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:45.063204 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-97221b4d-2702-4a56-a6e7-ae00d5a507cd tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:45.063920 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-97221b4d-2702-4a56-a6e7-ae00d5a507cd tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:45.064893 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-97221b4d-2702-4a56-a6e7-ae00d5a507cd tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:45.065021 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c8f8ea53-f4de-4333-bcf0-5ad0e6c147a9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:45.065714 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-97221b4d-2702-4a56-a6e7-ae00d5a507cd tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:45.066554 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c8f8ea53-f4de-4333-bcf0-5ad0e6c147a9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:45.067790 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c8f8ea53-f4de-4333-bcf0-5ad0e6c147a9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1739 microversion: 2.20 time: 0.318557 Oct 12 18:34:45.079570 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 575/1150] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:44 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1739 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:34:45.091036 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-8526d4b3-e7dd-4496-ba80-bbe2938e5eff req-137c1b89-a058-439f-b10d-0350828ae3be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f0cf04d-323c-4749-b9ae-d35333eb565c", "tag": "ee9e0115-2251-43e7-8da4-8dd846258e7b"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:45.096100 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:34:45.096100 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:34:45.105833 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-97221b4d-2702-4a56-a6e7-ae00d5a507cd tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Going to try to terminate instance {{(pid=109168) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 18:34:45.117396 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-8526d4b3-e7dd-4496-ba80-bbe2938e5eff req-137c1b89-a058-439f-b10d-0350828ae3be service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:45.117934 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-8526d4b3-e7dd-4496-ba80-bbe2938e5eff req-137c1b89-a058-439f-b10d-0350828ae3be service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:45.147732 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-8526d4b3-e7dd-4496-ba80-bbe2938e5eff req-137c1b89-a058-439f-b10d-0350828ae3be service nova] Creating event network-changed:ee9e0115-2251-43e7-8da4-8dd846258e7b for instance 1f0cf04d-323c-4749-b9ae-d35333eb565c on hv-cinder-81322 Oct 12 18:34:45.158471 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-8526d4b3-e7dd-4496-ba80-bbe2938e5eff req-137c1b89-a058-439f-b10d-0350828ae3be service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081503 Oct 12 18:34:45.159394 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 576/1151] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:34:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:34:45.444311 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-97221b4d-2702-4a56-a6e7-ae00d5a507cd tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 204 len: 0 microversion: 2.1 time: 0.405409 Oct 12 18:34:45.446446 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 576/1152] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Oct 12 18:34:45 2021] DELETE /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 18:34:45.457672 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-dff1934d-aa54-40ec-abd6-9da61862a2f4 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:45.458678 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-dff1934d-aa54-40ec-abd6-9da61862a2f4 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:45.465531 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-dff1934d-aa54-40ec-abd6-9da61862a2f4 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:45.466237 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-dff1934d-aa54-40ec-abd6-9da61862a2f4 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:45.467872 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-dff1934d-aa54-40ec-abd6-9da61862a2f4 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:45.468643 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-dff1934d-aa54-40ec-abd6-9da61862a2f4 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:45.713039 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-dff1934d-aa54-40ec-abd6-9da61862a2f4 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:45.721216 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-dff1934d-aa54-40ec-abd6-9da61862a2f4 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1569 microversion: 2.1 time: 0.270201 Oct 12 18:34:45.721800 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 577/1153] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:34:45 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1569 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:34:46.089936 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0c719767-477e-4441-af07-db333624dd5f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:46.092258 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0c719767-477e-4441-af07-db333624dd5f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:46.099122 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0c719767-477e-4441-af07-db333624dd5f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:46.103198 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0c719767-477e-4441-af07-db333624dd5f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:46.104065 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0c719767-477e-4441-af07-db333624dd5f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:46.107046 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0c719767-477e-4441-af07-db333624dd5f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:46.308479 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0c719767-477e-4441-af07-db333624dd5f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:46.322034 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0c719767-477e-4441-af07-db333624dd5f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:46.324953 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0c719767-477e-4441-af07-db333624dd5f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:46.325090 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0c719767-477e-4441-af07-db333624dd5f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1739 microversion: 2.20 time: 0.243011 Oct 12 18:34:46.325866 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 577/1154] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:46 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1739 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:46.742042 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-079f765b-29b1-41c9-88c0-7ac45c03516a tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:46.742651 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-079f765b-29b1-41c9-88c0-7ac45c03516a tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:46.750605 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-079f765b-29b1-41c9-88c0-7ac45c03516a tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:46.751168 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-079f765b-29b1-41c9-88c0-7ac45c03516a tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:46.751981 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-079f765b-29b1-41c9-88c0-7ac45c03516a tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:46.752556 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-079f765b-29b1-41c9-88c0-7ac45c03516a tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:46.882480 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-079f765b-29b1-41c9-88c0-7ac45c03516a tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:46.890017 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-079f765b-29b1-41c9-88c0-7ac45c03516a tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1450 microversion: 2.1 time: 0.153332 Oct 12 18:34:46.906520 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 578/1155] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:34:46 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:34:47.342987 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-15471b8b-0f27-41e4-82ba-64480b407b98 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:47.343601 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-15471b8b-0f27-41e4-82ba-64480b407b98 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:47.350885 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-15471b8b-0f27-41e4-82ba-64480b407b98 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:47.351457 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-15471b8b-0f27-41e4-82ba-64480b407b98 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:47.352785 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-15471b8b-0f27-41e4-82ba-64480b407b98 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:47.353497 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-15471b8b-0f27-41e4-82ba-64480b407b98 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:47.603836 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-15471b8b-0f27-41e4-82ba-64480b407b98 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:47.616721 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-15471b8b-0f27-41e4-82ba-64480b407b98 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:47.618868 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-15471b8b-0f27-41e4-82ba-64480b407b98 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:47.622305 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-15471b8b-0f27-41e4-82ba-64480b407b98 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1739 microversion: 2.20 time: 0.283052 Oct 12 18:34:47.624260 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 578/1156] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:47 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1739 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:47.923517 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-2284a0e6-6cbd-4ed0-bccb-ce13fdfb210e tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:47.924846 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-2284a0e6-6cbd-4ed0-bccb-ce13fdfb210e tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:47.931778 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2284a0e6-6cbd-4ed0-bccb-ce13fdfb210e tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:47.932591 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2284a0e6-6cbd-4ed0-bccb-ce13fdfb210e tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:47.933448 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2284a0e6-6cbd-4ed0-bccb-ce13fdfb210e tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:47.933957 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2284a0e6-6cbd-4ed0-bccb-ce13fdfb210e tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:48.030365 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-2284a0e6-6cbd-4ed0-bccb-ce13fdfb210e tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:48.046096 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-2284a0e6-6cbd-4ed0-bccb-ce13fdfb210e tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1383 microversion: 2.1 time: 0.125116 Oct 12 18:34:48.062273 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 579/1157] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:34:47 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1383 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:34:48.121563 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-71e84bc8-332d-4288-a275-8f1d342b89c6 req-f614fbc9-be4c-475e-9c22-536b497936a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f0cf04d-323c-4749-b9ae-d35333eb565c", "name": "network-vif-deleted", "tag": "ee9e0115-2251-43e7-8da4-8dd846258e7b"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:48.125946 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:34:48.125946 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:34:48.134078 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-71e84bc8-332d-4288-a275-8f1d342b89c6 req-f614fbc9-be4c-475e-9c22-536b497936a8 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:48.134557 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-71e84bc8-332d-4288-a275-8f1d342b89c6 req-f614fbc9-be4c-475e-9c22-536b497936a8 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:48.145943 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-71e84bc8-332d-4288-a275-8f1d342b89c6 req-f614fbc9-be4c-475e-9c22-536b497936a8 service nova] Creating event network-vif-deleted:ee9e0115-2251-43e7-8da4-8dd846258e7b for instance 1f0cf04d-323c-4749-b9ae-d35333eb565c on hv-cinder-81322 Oct 12 18:34:48.151307 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-71e84bc8-332d-4288-a275-8f1d342b89c6 req-f614fbc9-be4c-475e-9c22-536b497936a8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033800 Oct 12 18:34:48.152049 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 579/1158] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:34:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:34:48.642406 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-9286382c-58a1-460c-89ae-77b5819e2379 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:48.643397 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-9286382c-58a1-460c-89ae-77b5819e2379 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:48.649246 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9286382c-58a1-460c-89ae-77b5819e2379 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:48.649693 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9286382c-58a1-460c-89ae-77b5819e2379 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:48.650474 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9286382c-58a1-460c-89ae-77b5819e2379 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:48.650909 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9286382c-58a1-460c-89ae-77b5819e2379 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:48.843878 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-9286382c-58a1-460c-89ae-77b5819e2379 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:48.852047 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-9286382c-58a1-460c-89ae-77b5819e2379 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:48.853579 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-9286382c-58a1-460c-89ae-77b5819e2379 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:48.854744 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-9286382c-58a1-460c-89ae-77b5819e2379 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1739 microversion: 2.20 time: 0.216680 Oct 12 18:34:48.855305 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 580/1159] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:48 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:49.068941 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-6c6d5738-ae88-4166-beed-dcdb19c58ccf tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:49.069646 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-6c6d5738-ae88-4166-beed-dcdb19c58ccf tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:49.075847 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6c6d5738-ae88-4166-beed-dcdb19c58ccf tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:49.076874 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6c6d5738-ae88-4166-beed-dcdb19c58ccf tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:49.077648 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6c6d5738-ae88-4166-beed-dcdb19c58ccf tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:49.078084 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6c6d5738-ae88-4166-beed-dcdb19c58ccf tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:49.141531 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-6c6d5738-ae88-4166-beed-dcdb19c58ccf tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6959ea6a5c642258bc40a8fe0c2b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a1ca7b8f55456eb3c6946099885e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:49.148832 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-6c6d5738-ae88-4166-beed-dcdb19c58ccf tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 200 len: 1220 microversion: 2.1 time: 0.083985 Oct 12 18:34:49.149537 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 580/1160] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:34:49 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:34:49.875231 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-b08e91cc-6055-4b18-9923-dca93b40d1f0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:49.875819 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-b08e91cc-6055-4b18-9923-dca93b40d1f0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:49.881770 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b08e91cc-6055-4b18-9923-dca93b40d1f0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:49.882209 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b08e91cc-6055-4b18-9923-dca93b40d1f0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:49.882984 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b08e91cc-6055-4b18-9923-dca93b40d1f0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:49.883449 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b08e91cc-6055-4b18-9923-dca93b40d1f0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:50.092842 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-b08e91cc-6055-4b18-9923-dca93b40d1f0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:50.101507 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-b08e91cc-6055-4b18-9923-dca93b40d1f0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:50.102987 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-b08e91cc-6055-4b18-9923-dca93b40d1f0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:50.105462 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-b08e91cc-6055-4b18-9923-dca93b40d1f0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1721 microversion: 2.20 time: 0.233024 Oct 12 18:34:50.105462 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 581/1161] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:49 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1721 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:34:50.167107 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-945ab3d0-54e1-4189-beaa-d570da0365b9 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:50.167731 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-945ab3d0-54e1-4189-beaa-d570da0365b9 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] [instance: 1f0cf04d-323c-4749-b9ae-d35333eb565c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:50.174188 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-945ab3d0-54e1-4189-beaa-d570da0365b9 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:50.174700 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-945ab3d0-54e1-4189-beaa-d570da0365b9 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:50.175535 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-945ab3d0-54e1-4189-beaa-d570da0365b9 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:50.175906 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-945ab3d0-54e1-4189-beaa-d570da0365b9 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:50.193343 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-945ab3d0-54e1-4189-beaa-d570da0365b9 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] HTTP exception thrown: Instance 1f0cf04d-323c-4749-b9ae-d35333eb565c could not be found. Oct 12 18:34:50.193939 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-945ab3d0-54e1-4189-beaa-d570da0365b9 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Returning 404 to user: Instance 1f0cf04d-323c-4749-b9ae-d35333eb565c could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:34:50.194778 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-945ab3d0-54e1-4189-beaa-d570da0365b9 tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c" status: 404 len: 111 microversion: 2.1 time: 0.031606 Oct 12 18:34:50.195351 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 581/1162] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:34:50 2021] GET /compute/v2.1/servers/1f0cf04d-323c-4749-b9ae-d35333eb565c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 18:34:50.369476 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-ccdfa530-f23c-443b-ae83-93698e9a2694 req-178a8c81-c505-468b-9a72-8d8fb06b1096 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a73458df-c845-4c48-9839-58d3acdfd4da", "name": "network-vif-unplugged", "status": "completed", "tag": "6b4b7683-8980-4bd3-9e9f-66f9276cb054"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:50.371180 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:34:50.371180 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:34:50.380351 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-ccdfa530-f23c-443b-ae83-93698e9a2694 req-178a8c81-c505-468b-9a72-8d8fb06b1096 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:50.381417 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-ccdfa530-f23c-443b-ae83-93698e9a2694 req-178a8c81-c505-468b-9a72-8d8fb06b1096 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:50.394226 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-ccdfa530-f23c-443b-ae83-93698e9a2694 req-178a8c81-c505-468b-9a72-8d8fb06b1096 service nova] Creating event network-vif-unplugged:6b4b7683-8980-4bd3-9e9f-66f9276cb054 for instance a73458df-c845-4c48-9839-58d3acdfd4da on hv-cinder-81322 Oct 12 18:34:50.400044 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-ccdfa530-f23c-443b-ae83-93698e9a2694 req-178a8c81-c505-468b-9a72-8d8fb06b1096 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033843 Oct 12 18:34:50.400635 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 582/1163] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:34:50 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 18:34:50.436310 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7cb064f1-6ffa-4347-8bcc-1342a2e8515a tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] Calling method '.version_select at 0x7fe297cad160>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:50.549271 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7cb064f1-6ffa-4347-8bcc-1342a2e8515a tempest-TestShelveInstance-542365470 tempest-TestShelveInstance-542365470-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1852199283" status: 202 len: 0 microversion: 2.1 time: 0.117338 Oct 12 18:34:50.549849 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 582/1164] 10.222.0.18 () {58 vars in 1253 bytes} [Tue Oct 12 18:34:50 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1852199283 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:34:51.123164 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-cf7d98b4-ae3f-44c8-8e8f-2dd6f24ce006 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:51.124037 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-cf7d98b4-ae3f-44c8-8e8f-2dd6f24ce006 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:51.130846 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cf7d98b4-ae3f-44c8-8e8f-2dd6f24ce006 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:51.131353 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cf7d98b4-ae3f-44c8-8e8f-2dd6f24ce006 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:51.132340 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cf7d98b4-ae3f-44c8-8e8f-2dd6f24ce006 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:51.132861 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cf7d98b4-ae3f-44c8-8e8f-2dd6f24ce006 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:51.265028 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-cf7d98b4-ae3f-44c8-8e8f-2dd6f24ce006 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:51.274506 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-cf7d98b4-ae3f-44c8-8e8f-2dd6f24ce006 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:51.276320 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-cf7d98b4-ae3f-44c8-8e8f-2dd6f24ce006 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:51.277596 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-cf7d98b4-ae3f-44c8-8e8f-2dd6f24ce006 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1721 microversion: 2.20 time: 0.158523 Oct 12 18:34:51.278371 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 583/1165] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:51 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:52.298231 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d6802fd5-e4d9-4b6a-82f0-73931cbeb5cf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:52.299517 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d6802fd5-e4d9-4b6a-82f0-73931cbeb5cf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:52.307927 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d6802fd5-e4d9-4b6a-82f0-73931cbeb5cf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:52.308367 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d6802fd5-e4d9-4b6a-82f0-73931cbeb5cf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:52.309564 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d6802fd5-e4d9-4b6a-82f0-73931cbeb5cf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:52.312285 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d6802fd5-e4d9-4b6a-82f0-73931cbeb5cf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:52.469789 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-469b6dd9-8629-4b95-ba7f-ac116271c3ca tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:52.474850 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d6802fd5-e4d9-4b6a-82f0-73931cbeb5cf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:52.478930 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-469b6dd9-8629-4b95-ba7f-ac116271c3ca tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:52.485906 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d6802fd5-e4d9-4b6a-82f0-73931cbeb5cf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:52.489086 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d6802fd5-e4d9-4b6a-82f0-73931cbeb5cf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:52.492658 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-469b6dd9-8629-4b95-ba7f-ac116271c3ca tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:52.497153 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-469b6dd9-8629-4b95-ba7f-ac116271c3ca tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:52.497153 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-469b6dd9-8629-4b95-ba7f-ac116271c3ca tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:52.497153 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-469b6dd9-8629-4b95-ba7f-ac116271c3ca tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:52.499470 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d6802fd5-e4d9-4b6a-82f0-73931cbeb5cf tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1721 microversion: 2.20 time: 0.206052 Oct 12 18:34:52.500048 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 583/1166] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:52 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:52.548846 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-469b6dd9-8629-4b95-ba7f-ac116271c3ca tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.083313 Oct 12 18:34:52.565462 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 584/1167] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Oct 12 18:34:52 2021] GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/os-volume_attachments => generated 371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 18:34:52.865253 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-88c837b8-78d9-4627-9043-9a8e40a559b9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:52.865752 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-88c837b8-78d9-4627-9043-9a8e40a559b9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:52.871667 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-88c837b8-78d9-4627-9043-9a8e40a559b9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:52.872119 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-88c837b8-78d9-4627-9043-9a8e40a559b9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:52.873105 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-88c837b8-78d9-4627-9043-9a8e40a559b9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:52.873545 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-88c837b8-78d9-4627-9043-9a8e40a559b9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:52.902966 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-88c837b8-78d9-4627-9043-9a8e40a559b9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/os-volume_attachments/d43ef8a1-e005-44f2-b09f-3bf5c284e285" status: 200 len: 194 microversion: 2.1 time: 0.041398 Oct 12 18:34:52.903480 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 584/1168] 10.222.0.18 () {58 vars in 1412 bytes} [Tue Oct 12 18:34:52 2021] GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/os-volume_attachments/d43ef8a1-e005-44f2-b09f-3bf5c284e285 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:34:52.913793 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-b5badb14-d2c7-4f4a-99e3-e67067190166 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:52.914390 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-b5badb14-d2c7-4f4a-99e3-e67067190166 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:52.920980 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b5badb14-d2c7-4f4a-99e3-e67067190166 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:52.921418 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b5badb14-d2c7-4f4a-99e3-e67067190166 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:52.922182 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b5badb14-d2c7-4f4a-99e3-e67067190166 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:52.922609 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b5badb14-d2c7-4f4a-99e3-e67067190166 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:53.019549 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.objects.instance [None req-b5badb14-d2c7-4f4a-99e3-e67067190166 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lazy-loading 'services' on Instance uuid 4adfbcc5-a227-49b4-aea6-24a58adcbd78 {{(pid=109169) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:34:53.273378 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-b5badb14-d2c7-4f4a-99e3-e67067190166 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/os-volume_attachments/d43ef8a1-e005-44f2-b09f-3bf5c284e285" status: 202 len: 0 microversion: 2.1 time: 0.363004 Oct 12 18:34:53.273977 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 585/1169] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Oct 12 18:34:52 2021] DELETE /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/os-volume_attachments/d43ef8a1-e005-44f2-b09f-3bf5c284e285 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:34:53.519812 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-94b75275-5688-4b89-bd0b-d5d21bae0b9a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:53.520439 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-94b75275-5688-4b89-bd0b-d5d21bae0b9a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:53.527397 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-94b75275-5688-4b89-bd0b-d5d21bae0b9a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:53.528047 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-94b75275-5688-4b89-bd0b-d5d21bae0b9a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:53.528861 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-94b75275-5688-4b89-bd0b-d5d21bae0b9a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:53.529298 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-94b75275-5688-4b89-bd0b-d5d21bae0b9a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:53.766751 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-94b75275-5688-4b89-bd0b-d5d21bae0b9a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:53.774612 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-94b75275-5688-4b89-bd0b-d5d21bae0b9a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:53.776138 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-94b75275-5688-4b89-bd0b-d5d21bae0b9a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:53.777380 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-94b75275-5688-4b89-bd0b-d5d21bae0b9a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1664 microversion: 2.20 time: 0.261207 Oct 12 18:34:53.777873 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 585/1170] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:53 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1664 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:53.797401 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-f801381e-e22b-4ca5-9695-a2f14458fa4d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03aaed40-05b9-43a6-ac26-78fc1a1eb081"}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:53.798735 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-f801381e-e22b-4ca5-9695-a2f14458fa4d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:53.805694 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f801381e-e22b-4ca5-9695-a2f14458fa4d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:53.807955 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f801381e-e22b-4ca5-9695-a2f14458fa4d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:53.808769 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f801381e-e22b-4ca5-9695-a2f14458fa4d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:53.809208 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f801381e-e22b-4ca5-9695-a2f14458fa4d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:54.988022 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-f801381e-e22b-4ca5-9695-a2f14458fa4d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.195573 Oct 12 18:34:54.988726 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 586/1171] 10.222.0.18 () {62 vars in 1363 bytes} [Tue Oct 12 18:34:53 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/os-volume_attachments => generated 188 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 18:34:55.105286 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-29c30875-38b4-4b2d-b2ca-2672ab915ea7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:55.105879 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-29c30875-38b4-4b2d-b2ca-2672ab915ea7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:55.112060 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-29c30875-38b4-4b2d-b2ca-2672ab915ea7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:55.112540 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-29c30875-38b4-4b2d-b2ca-2672ab915ea7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:55.113318 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-29c30875-38b4-4b2d-b2ca-2672ab915ea7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:55.113745 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-29c30875-38b4-4b2d-b2ca-2672ab915ea7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:55.939315 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-29c30875-38b4-4b2d-b2ca-2672ab915ea7 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/os-volume_attachments/03aaed40-05b9-43a6-ac26-78fc1a1eb081" status: 202 len: 0 microversion: 2.20 time: 0.837552 Oct 12 18:34:55.939934 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 586/1172] 10.222.0.18 () {60 vars in 1456 bytes} [Tue Oct 12 18:34:55 2021] DELETE /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/os-volume_attachments/03aaed40-05b9-43a6-ac26-78fc1a1eb081 => generated 0 bytes in 839 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 18:34:55.995747 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-8418c91e-6785-4ab3-8a46-b786fc356594 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:34:55.996295 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-8418c91e-6785-4ab3-8a46-b786fc356594 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:56.002884 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8418c91e-6785-4ab3-8a46-b786fc356594 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:56.003344 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8418c91e-6785-4ab3-8a46-b786fc356594 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:56.004084 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8418c91e-6785-4ab3-8a46-b786fc356594 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:56.004535 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8418c91e-6785-4ab3-8a46-b786fc356594 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:56.271460 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-8418c91e-6785-4ab3-8a46-b786fc356594 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action" status: 202 len: 0 microversion: 2.20 time: 0.279623 Oct 12 18:34:56.272159 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 587/1173] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Oct 12 18:34:55 2021] POST /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 18:34:56.283633 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4df4094e-db77-441e-b14f-1cfaf493fc6d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:56.289195 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4df4094e-db77-441e-b14f-1cfaf493fc6d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:56.308187 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4df4094e-db77-441e-b14f-1cfaf493fc6d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:56.308712 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4df4094e-db77-441e-b14f-1cfaf493fc6d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:56.309494 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4df4094e-db77-441e-b14f-1cfaf493fc6d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:56.309920 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4df4094e-db77-441e-b14f-1cfaf493fc6d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:56.528440 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4df4094e-db77-441e-b14f-1cfaf493fc6d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:56.539533 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4df4094e-db77-441e-b14f-1cfaf493fc6d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:56.541063 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4df4094e-db77-441e-b14f-1cfaf493fc6d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:56.542239 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4df4094e-db77-441e-b14f-1cfaf493fc6d tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1672 microversion: 2.20 time: 0.263552 Oct 12 18:34:56.542791 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 587/1174] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:56 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1672 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:57.564062 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-50f39857-87d5-447d-b8d2-7d1104a93b23 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:57.564769 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-50f39857-87d5-447d-b8d2-7d1104a93b23 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:57.573891 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-50f39857-87d5-447d-b8d2-7d1104a93b23 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:57.574909 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-50f39857-87d5-447d-b8d2-7d1104a93b23 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:57.576076 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-50f39857-87d5-447d-b8d2-7d1104a93b23 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:57.576534 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-50f39857-87d5-447d-b8d2-7d1104a93b23 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:57.722208 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-50f39857-87d5-447d-b8d2-7d1104a93b23 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:57.735088 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-50f39857-87d5-447d-b8d2-7d1104a93b23 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:57.736760 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-50f39857-87d5-447d-b8d2-7d1104a93b23 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:57.738191 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-50f39857-87d5-447d-b8d2-7d1104a93b23 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1672 microversion: 2.20 time: 0.181543 Oct 12 18:34:57.739702 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 588/1175] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:57 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1672 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:34:58.757985 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5bc68994-09ee-43cd-8914-ea59763a2b5b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:34:58.759424 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5bc68994-09ee-43cd-8914-ea59763a2b5b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:34:58.780700 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5bc68994-09ee-43cd-8914-ea59763a2b5b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:58.781667 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5bc68994-09ee-43cd-8914-ea59763a2b5b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:58.784848 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5bc68994-09ee-43cd-8914-ea59763a2b5b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:34:58.784848 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5bc68994-09ee-43cd-8914-ea59763a2b5b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:34:59.003816 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5bc68994-09ee-43cd-8914-ea59763a2b5b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:59.012208 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5bc68994-09ee-43cd-8914-ea59763a2b5b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:59.014304 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5bc68994-09ee-43cd-8914-ea59763a2b5b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:34:59.015476 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5bc68994-09ee-43cd-8914-ea59763a2b5b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1730 microversion: 2.20 time: 0.261544 Oct 12 18:34:59.016031 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 588/1176] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:34:58 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1730 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:35:00.034183 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-97816b01-7250-4662-99de-3e0d035b3d37 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:00.035061 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-97816b01-7250-4662-99de-3e0d035b3d37 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:00.041497 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-97816b01-7250-4662-99de-3e0d035b3d37 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:00.041993 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-97816b01-7250-4662-99de-3e0d035b3d37 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:00.042866 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-97816b01-7250-4662-99de-3e0d035b3d37 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:00.043478 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-97816b01-7250-4662-99de-3e0d035b3d37 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:00.198158 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-97816b01-7250-4662-99de-3e0d035b3d37 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:00.207451 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-97816b01-7250-4662-99de-3e0d035b3d37 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:00.209860 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-97816b01-7250-4662-99de-3e0d035b3d37 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:00.211303 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-97816b01-7250-4662-99de-3e0d035b3d37 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1730 microversion: 2.20 time: 0.180866 Oct 12 18:35:00.212639 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 589/1177] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:35:00 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:35:01.230720 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d5c9fc21-896d-434b-a0eb-4f203ae55743 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:01.231286 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d5c9fc21-896d-434b-a0eb-4f203ae55743 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:01.237902 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d5c9fc21-896d-434b-a0eb-4f203ae55743 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:01.238341 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d5c9fc21-896d-434b-a0eb-4f203ae55743 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:01.239101 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d5c9fc21-896d-434b-a0eb-4f203ae55743 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:01.239529 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d5c9fc21-896d-434b-a0eb-4f203ae55743 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:01.371553 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d5c9fc21-896d-434b-a0eb-4f203ae55743 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:01.380569 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d5c9fc21-896d-434b-a0eb-4f203ae55743 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:01.382066 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d5c9fc21-896d-434b-a0eb-4f203ae55743 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:01.383231 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d5c9fc21-896d-434b-a0eb-4f203ae55743 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1730 microversion: 2.20 time: 0.156296 Oct 12 18:35:01.383995 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 589/1178] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:35:01 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:35:02.401526 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-f55be12e-c4e4-478f-98da-396a9ed8afa0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:02.402124 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-f55be12e-c4e4-478f-98da-396a9ed8afa0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:02.409781 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f55be12e-c4e4-478f-98da-396a9ed8afa0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:02.410265 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f55be12e-c4e4-478f-98da-396a9ed8afa0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:02.411106 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f55be12e-c4e4-478f-98da-396a9ed8afa0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:02.411532 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f55be12e-c4e4-478f-98da-396a9ed8afa0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:02.532219 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-f55be12e-c4e4-478f-98da-396a9ed8afa0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:02.539847 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-f55be12e-c4e4-478f-98da-396a9ed8afa0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:02.541385 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-f55be12e-c4e4-478f-98da-396a9ed8afa0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:02.542529 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-f55be12e-c4e4-478f-98da-396a9ed8afa0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1730 microversion: 2.20 time: 0.144737 Oct 12 18:35:02.543088 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 590/1179] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:35:02 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1730 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:35:03.560334 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f047cfe9-e5f9-4452-b3c4-b2c59a902b76 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:03.560961 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f047cfe9-e5f9-4452-b3c4-b2c59a902b76 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:03.566727 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f047cfe9-e5f9-4452-b3c4-b2c59a902b76 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:03.567161 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f047cfe9-e5f9-4452-b3c4-b2c59a902b76 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:03.567914 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f047cfe9-e5f9-4452-b3c4-b2c59a902b76 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:03.568337 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f047cfe9-e5f9-4452-b3c4-b2c59a902b76 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:03.699624 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f047cfe9-e5f9-4452-b3c4-b2c59a902b76 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:03.707655 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f047cfe9-e5f9-4452-b3c4-b2c59a902b76 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:03.709178 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f047cfe9-e5f9-4452-b3c4-b2c59a902b76 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:03.710312 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f047cfe9-e5f9-4452-b3c4-b2c59a902b76 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1730 microversion: 2.20 time: 0.153655 Oct 12 18:35:03.710859 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 590/1180] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:35:03 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:35:04.740569 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-65276da6-c494-4201-88a1-61013343baef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:04.742727 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-65276da6-c494-4201-88a1-61013343baef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:04.754921 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-65276da6-c494-4201-88a1-61013343baef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:04.755845 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-65276da6-c494-4201-88a1-61013343baef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:04.757266 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-65276da6-c494-4201-88a1-61013343baef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:04.758069 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-65276da6-c494-4201-88a1-61013343baef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:04.911351 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-65276da6-c494-4201-88a1-61013343baef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:04.920322 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-65276da6-c494-4201-88a1-61013343baef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:04.922198 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-65276da6-c494-4201-88a1-61013343baef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:04.923337 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-65276da6-c494-4201-88a1-61013343baef tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1730 microversion: 2.20 time: 0.191660 Oct 12 18:35:04.923888 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 591/1181] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:35:04 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:35:05.941925 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b90649e9-5b33-4a7f-90f5-685911bb65b2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:05.942508 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b90649e9-5b33-4a7f-90f5-685911bb65b2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:05.948286 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b90649e9-5b33-4a7f-90f5-685911bb65b2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:05.948760 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b90649e9-5b33-4a7f-90f5-685911bb65b2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:05.949522 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b90649e9-5b33-4a7f-90f5-685911bb65b2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:05.949956 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b90649e9-5b33-4a7f-90f5-685911bb65b2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:06.073132 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b90649e9-5b33-4a7f-90f5-685911bb65b2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:06.081235 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b90649e9-5b33-4a7f-90f5-685911bb65b2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:06.082839 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b90649e9-5b33-4a7f-90f5-685911bb65b2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:06.084339 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b90649e9-5b33-4a7f-90f5-685911bb65b2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1730 microversion: 2.20 time: 0.145991 Oct 12 18:35:06.084927 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 591/1182] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:35:05 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:35:07.102949 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-8499b79c-0cda-4fe7-939f-b1035d2f8f80 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:07.103586 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-8499b79c-0cda-4fe7-939f-b1035d2f8f80 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:07.113121 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8499b79c-0cda-4fe7-939f-b1035d2f8f80 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:07.113858 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8499b79c-0cda-4fe7-939f-b1035d2f8f80 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:07.114828 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8499b79c-0cda-4fe7-939f-b1035d2f8f80 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:07.115286 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8499b79c-0cda-4fe7-939f-b1035d2f8f80 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:07.238158 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-8499b79c-0cda-4fe7-939f-b1035d2f8f80 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:07.250784 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-8499b79c-0cda-4fe7-939f-b1035d2f8f80 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:07.251987 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-8499b79c-0cda-4fe7-939f-b1035d2f8f80 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:07.253250 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-8499b79c-0cda-4fe7-939f-b1035d2f8f80 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1730 microversion: 2.20 time: 0.153941 Oct 12 18:35:07.253812 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 592/1183] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:35:07 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:35:08.272787 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a3e1849f-9b4d-4394-bab4-e427cef101c9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:08.273399 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a3e1849f-9b4d-4394-bab4-e427cef101c9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:08.279894 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a3e1849f-9b4d-4394-bab4-e427cef101c9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:08.280331 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a3e1849f-9b4d-4394-bab4-e427cef101c9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:08.281120 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a3e1849f-9b4d-4394-bab4-e427cef101c9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:08.281545 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a3e1849f-9b4d-4394-bab4-e427cef101c9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:08.408952 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a3e1849f-9b4d-4394-bab4-e427cef101c9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:08.417220 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a3e1849f-9b4d-4394-bab4-e427cef101c9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:08.418720 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a3e1849f-9b4d-4394-bab4-e427cef101c9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:08.419896 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a3e1849f-9b4d-4394-bab4-e427cef101c9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1730 microversion: 2.20 time: 0.152011 Oct 12 18:35:08.420539 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 592/1184] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:35:08 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:35:09.441048 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-d9add49c-5cb4-4160-a03f-8e3756477afa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:09.441588 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-d9add49c-5cb4-4160-a03f-8e3756477afa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:09.447547 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d9add49c-5cb4-4160-a03f-8e3756477afa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:09.448059 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d9add49c-5cb4-4160-a03f-8e3756477afa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:09.448896 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d9add49c-5cb4-4160-a03f-8e3756477afa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:09.449323 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d9add49c-5cb4-4160-a03f-8e3756477afa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:09.587635 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-d9add49c-5cb4-4160-a03f-8e3756477afa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:09.595924 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-d9add49c-5cb4-4160-a03f-8e3756477afa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:09.597443 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-d9add49c-5cb4-4160-a03f-8e3756477afa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:09.598577 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-d9add49c-5cb4-4160-a03f-8e3756477afa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1730 microversion: 2.20 time: 0.161301 Oct 12 18:35:09.599139 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 593/1185] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:35:09 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:35:10.616999 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3b20a47b-0dd0-47af-9d2c-a14883a3d468 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:10.617602 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3b20a47b-0dd0-47af-9d2c-a14883a3d468 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:10.629871 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3b20a47b-0dd0-47af-9d2c-a14883a3d468 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:10.630461 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3b20a47b-0dd0-47af-9d2c-a14883a3d468 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:10.631368 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3b20a47b-0dd0-47af-9d2c-a14883a3d468 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:10.632009 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3b20a47b-0dd0-47af-9d2c-a14883a3d468 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:10.762663 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3b20a47b-0dd0-47af-9d2c-a14883a3d468 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:10.770421 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3b20a47b-0dd0-47af-9d2c-a14883a3d468 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:10.771931 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3b20a47b-0dd0-47af-9d2c-a14883a3d468 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:10.773117 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3b20a47b-0dd0-47af-9d2c-a14883a3d468 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1730 microversion: 2.20 time: 0.159741 Oct 12 18:35:10.773679 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 593/1186] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:35:10 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:35:11.792895 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-2e2f75ab-ef89-4bb1-baa6-e1663a98c24b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:11.793649 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-2e2f75ab-ef89-4bb1-baa6-e1663a98c24b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:11.799739 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2e2f75ab-ef89-4bb1-baa6-e1663a98c24b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:11.800173 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2e2f75ab-ef89-4bb1-baa6-e1663a98c24b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:11.800982 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2e2f75ab-ef89-4bb1-baa6-e1663a98c24b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:11.801403 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2e2f75ab-ef89-4bb1-baa6-e1663a98c24b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:11.931296 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-2e2f75ab-ef89-4bb1-baa6-e1663a98c24b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:11.945025 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-2e2f75ab-ef89-4bb1-baa6-e1663a98c24b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:11.946860 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-2e2f75ab-ef89-4bb1-baa6-e1663a98c24b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:11.948287 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-2e2f75ab-ef89-4bb1-baa6-e1663a98c24b tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1730 microversion: 2.20 time: 0.160178 Oct 12 18:35:11.954343 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 594/1187] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:35:11 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:35:12.967265 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-09f1b5b7-953c-4c17-a8d8-a2ed2d46b509 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:12.967973 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-09f1b5b7-953c-4c17-a8d8-a2ed2d46b509 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:12.973837 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-09f1b5b7-953c-4c17-a8d8-a2ed2d46b509 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:12.974489 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-09f1b5b7-953c-4c17-a8d8-a2ed2d46b509 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:12.975256 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-09f1b5b7-953c-4c17-a8d8-a2ed2d46b509 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:12.975691 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-09f1b5b7-953c-4c17-a8d8-a2ed2d46b509 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:13.098064 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-09f1b5b7-953c-4c17-a8d8-a2ed2d46b509 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:13.105975 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-09f1b5b7-953c-4c17-a8d8-a2ed2d46b509 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:13.108105 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-09f1b5b7-953c-4c17-a8d8-a2ed2d46b509 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:13.109276 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-09f1b5b7-953c-4c17-a8d8-a2ed2d46b509 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1730 microversion: 2.20 time: 0.146238 Oct 12 18:35:13.109828 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 594/1188] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:35:12 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:35:14.127613 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-d7e6ed16-8a94-4897-baf1-2771f1563c0c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:14.128213 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-d7e6ed16-8a94-4897-baf1-2771f1563c0c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:14.133849 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d7e6ed16-8a94-4897-baf1-2771f1563c0c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:14.134282 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d7e6ed16-8a94-4897-baf1-2771f1563c0c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:14.135027 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d7e6ed16-8a94-4897-baf1-2771f1563c0c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:14.135448 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d7e6ed16-8a94-4897-baf1-2771f1563c0c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:14.263556 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-d7e6ed16-8a94-4897-baf1-2771f1563c0c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:14.271599 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-d7e6ed16-8a94-4897-baf1-2771f1563c0c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:14.273118 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-d7e6ed16-8a94-4897-baf1-2771f1563c0c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:14.274417 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-d7e6ed16-8a94-4897-baf1-2771f1563c0c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1730 microversion: 2.20 time: 0.150374 Oct 12 18:35:14.283478 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 595/1189] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:35:14 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:35:15.294826 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-82566e59-fa04-420b-a251-9b299d780ac2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:15.296208 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-82566e59-fa04-420b-a251-9b299d780ac2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:15.302521 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-82566e59-fa04-420b-a251-9b299d780ac2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:15.303178 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-82566e59-fa04-420b-a251-9b299d780ac2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:15.304069 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-82566e59-fa04-420b-a251-9b299d780ac2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:15.304476 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-82566e59-fa04-420b-a251-9b299d780ac2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:15.429876 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-82566e59-fa04-420b-a251-9b299d780ac2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:15.439480 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-82566e59-fa04-420b-a251-9b299d780ac2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:15.441197 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-82566e59-fa04-420b-a251-9b299d780ac2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:15.442695 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-82566e59-fa04-420b-a251-9b299d780ac2 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1730 microversion: 2.20 time: 0.152850 Oct 12 18:35:15.454556 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 595/1190] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:35:15 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:35:16.462469 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-4a3bf443-147d-4d36-9f94-03a3fba77fbe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:16.463141 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-4a3bf443-147d-4d36-9f94-03a3fba77fbe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:16.469913 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4a3bf443-147d-4d36-9f94-03a3fba77fbe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:16.470353 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4a3bf443-147d-4d36-9f94-03a3fba77fbe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:16.471172 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4a3bf443-147d-4d36-9f94-03a3fba77fbe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:16.471598 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4a3bf443-147d-4d36-9f94-03a3fba77fbe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:16.625429 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-4a3bf443-147d-4d36-9f94-03a3fba77fbe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:16.635306 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-4a3bf443-147d-4d36-9f94-03a3fba77fbe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:16.637179 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-4a3bf443-147d-4d36-9f94-03a3fba77fbe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:16.639483 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-4a3bf443-147d-4d36-9f94-03a3fba77fbe tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1730 microversion: 2.20 time: 0.181157 Oct 12 18:35:16.649225 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 596/1191] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:35:16 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:35:17.673093 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f68f1e66-d822-4bcf-8f9d-72c5ae7822e0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:17.673794 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f68f1e66-d822-4bcf-8f9d-72c5ae7822e0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:17.680113 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f68f1e66-d822-4bcf-8f9d-72c5ae7822e0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:17.680659 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f68f1e66-d822-4bcf-8f9d-72c5ae7822e0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:17.681427 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f68f1e66-d822-4bcf-8f9d-72c5ae7822e0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:17.681856 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f68f1e66-d822-4bcf-8f9d-72c5ae7822e0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:17.803972 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f68f1e66-d822-4bcf-8f9d-72c5ae7822e0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:17.811704 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f68f1e66-d822-4bcf-8f9d-72c5ae7822e0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:17.813227 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f68f1e66-d822-4bcf-8f9d-72c5ae7822e0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:17.814367 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f68f1e66-d822-4bcf-8f9d-72c5ae7822e0 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1730 microversion: 2.20 time: 0.146091 Oct 12 18:35:17.814927 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 596/1192] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:35:17 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:35:18.832890 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-2034e958-480c-4101-a1ca-8bbce4d88ce4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:18.833471 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-2034e958-480c-4101-a1ca-8bbce4d88ce4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:18.839315 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2034e958-480c-4101-a1ca-8bbce4d88ce4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:18.839772 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2034e958-480c-4101-a1ca-8bbce4d88ce4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:18.841167 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2034e958-480c-4101-a1ca-8bbce4d88ce4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:18.841601 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2034e958-480c-4101-a1ca-8bbce4d88ce4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:18.973759 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-2034e958-480c-4101-a1ca-8bbce4d88ce4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:18.983093 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-2034e958-480c-4101-a1ca-8bbce4d88ce4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:18.985195 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-2034e958-480c-4101-a1ca-8bbce4d88ce4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:18.986322 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-2034e958-480c-4101-a1ca-8bbce4d88ce4 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1730 microversion: 2.20 time: 0.157188 Oct 12 18:35:18.986863 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 597/1193] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:35:18 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:35:20.004900 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3a45ab1a-b213-4bb9-b8a0-c6ef860bf24a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:20.005432 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3a45ab1a-b213-4bb9-b8a0-c6ef860bf24a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:20.011236 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3a45ab1a-b213-4bb9-b8a0-c6ef860bf24a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:20.011677 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3a45ab1a-b213-4bb9-b8a0-c6ef860bf24a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:20.013026 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3a45ab1a-b213-4bb9-b8a0-c6ef860bf24a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:20.013453 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3a45ab1a-b213-4bb9-b8a0-c6ef860bf24a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:20.129332 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3a45ab1a-b213-4bb9-b8a0-c6ef860bf24a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:20.136979 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3a45ab1a-b213-4bb9-b8a0-c6ef860bf24a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:20.139046 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3a45ab1a-b213-4bb9-b8a0-c6ef860bf24a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:20.140183 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3a45ab1a-b213-4bb9-b8a0-c6ef860bf24a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1730 microversion: 2.20 time: 0.139429 Oct 12 18:35:20.140779 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 597/1194] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:35:19 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1730 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:35:21.159139 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-87297b80-31c4-4835-bc92-82fccccbac5f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:21.159660 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-87297b80-31c4-4835-bc92-82fccccbac5f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:21.165415 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-87297b80-31c4-4835-bc92-82fccccbac5f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:21.165860 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-87297b80-31c4-4835-bc92-82fccccbac5f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:21.166611 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-87297b80-31c4-4835-bc92-82fccccbac5f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:21.167038 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-87297b80-31c4-4835-bc92-82fccccbac5f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:21.285850 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-87297b80-31c4-4835-bc92-82fccccbac5f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:21.295158 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-87297b80-31c4-4835-bc92-82fccccbac5f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:21.296720 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-87297b80-31c4-4835-bc92-82fccccbac5f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:21.298076 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-87297b80-31c4-4835-bc92-82fccccbac5f tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1730 microversion: 2.20 time: 0.143041 Oct 12 18:35:21.303188 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 598/1195] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:35:21 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1730 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:35:22.316104 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-fa85d76a-ec89-4fa5-bcaa-221da358d8da tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:22.316745 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-fa85d76a-ec89-4fa5-bcaa-221da358d8da tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:22.322528 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fa85d76a-ec89-4fa5-bcaa-221da358d8da tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:22.322972 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fa85d76a-ec89-4fa5-bcaa-221da358d8da tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:22.323732 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fa85d76a-ec89-4fa5-bcaa-221da358d8da tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:22.324168 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fa85d76a-ec89-4fa5-bcaa-221da358d8da tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:22.687137 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-fa85d76a-ec89-4fa5-bcaa-221da358d8da tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:22.694938 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-fa85d76a-ec89-4fa5-bcaa-221da358d8da tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:22.696454 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-fa85d76a-ec89-4fa5-bcaa-221da358d8da tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:22.697620 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-fa85d76a-ec89-4fa5-bcaa-221da358d8da tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1730 microversion: 2.20 time: 0.385168 Oct 12 18:35:22.698159 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 598/1196] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:35:22 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1730 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:35:23.715704 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-f84a96de-2a0b-4440-9581-fa1653b7c915 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:23.716239 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-f84a96de-2a0b-4440-9581-fa1653b7c915 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:23.722048 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f84a96de-2a0b-4440-9581-fa1653b7c915 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:23.722515 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f84a96de-2a0b-4440-9581-fa1653b7c915 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:23.723407 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f84a96de-2a0b-4440-9581-fa1653b7c915 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:23.723835 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f84a96de-2a0b-4440-9581-fa1653b7c915 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:23.849067 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-f84a96de-2a0b-4440-9581-fa1653b7c915 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:23.857347 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-f84a96de-2a0b-4440-9581-fa1653b7c915 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:23.858826 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-f84a96de-2a0b-4440-9581-fa1653b7c915 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:23.859958 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-f84a96de-2a0b-4440-9581-fa1653b7c915 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1730 microversion: 2.20 time: 0.148085 Oct 12 18:35:23.860529 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 599/1197] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:35:23 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:35:24.878675 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-cbe8325d-7bb3-40e0-b029-dd3788b30379 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:24.886283 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-cbe8325d-7bb3-40e0-b029-dd3788b30379 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:24.886283 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cbe8325d-7bb3-40e0-b029-dd3788b30379 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:24.886283 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cbe8325d-7bb3-40e0-b029-dd3788b30379 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:24.886630 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cbe8325d-7bb3-40e0-b029-dd3788b30379 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:24.886760 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cbe8325d-7bb3-40e0-b029-dd3788b30379 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:25.019349 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-cbe8325d-7bb3-40e0-b029-dd3788b30379 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:25.026980 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-cbe8325d-7bb3-40e0-b029-dd3788b30379 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:25.028494 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-cbe8325d-7bb3-40e0-b029-dd3788b30379 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:25.029909 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-cbe8325d-7bb3-40e0-b029-dd3788b30379 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1730 microversion: 2.20 time: 0.154777 Oct 12 18:35:25.030466 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 599/1198] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:35:24 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:35:26.047420 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-e5b90b94-3984-4f1f-9a8b-d1b9e0c7b85a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:26.048073 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-e5b90b94-3984-4f1f-9a8b-d1b9e0c7b85a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:26.053718 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e5b90b94-3984-4f1f-9a8b-d1b9e0c7b85a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:26.054160 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e5b90b94-3984-4f1f-9a8b-d1b9e0c7b85a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:26.054918 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e5b90b94-3984-4f1f-9a8b-d1b9e0c7b85a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:26.055342 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e5b90b94-3984-4f1f-9a8b-d1b9e0c7b85a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:26.179207 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-e5b90b94-3984-4f1f-9a8b-d1b9e0c7b85a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:26.186882 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-e5b90b94-3984-4f1f-9a8b-d1b9e0c7b85a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:26.188473 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-e5b90b94-3984-4f1f-9a8b-d1b9e0c7b85a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:26.189543 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-e5b90b94-3984-4f1f-9a8b-d1b9e0c7b85a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1730 microversion: 2.20 time: 0.145692 Oct 12 18:35:26.190100 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 600/1199] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:35:26 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:35:27.158349 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c7716333-22f4-4e4d-8ed4-be6d51fa8e50 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:27.159116 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c7716333-22f4-4e4d-8ed4-be6d51fa8e50 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:27.165080 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c7716333-22f4-4e4d-8ed4-be6d51fa8e50 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:27.172643 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c7716333-22f4-4e4d-8ed4-be6d51fa8e50 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:27.172643 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c7716333-22f4-4e4d-8ed4-be6d51fa8e50 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:27.172643 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c7716333-22f4-4e4d-8ed4-be6d51fa8e50 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:27.198500 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c7716333-22f4-4e4d-8ed4-be6d51fa8e50 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/os-volume_attachments/0fe1c23b-a2ad-4e06-87c3-c04e5f5814a2" status: 200 len: 194 microversion: 2.1 time: 0.045872 Oct 12 18:35:27.199135 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 600/1200] 10.222.0.18 () {58 vars in 1412 bytes} [Tue Oct 12 18:35:27 2021] GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/os-volume_attachments/0fe1c23b-a2ad-4e06-87c3-c04e5f5814a2 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 18:35:27.208203 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-9fedb22e-4558-46b1-b7ec-87112c83d388 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:27.208798 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d15fa86d-bc43-415b-92b5-3c2dfd4145d0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:27.208904 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-9fedb22e-4558-46b1-b7ec-87112c83d388 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:27.209005 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d15fa86d-bc43-415b-92b5-3c2dfd4145d0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:27.214713 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9fedb22e-4558-46b1-b7ec-87112c83d388 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:27.214876 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d15fa86d-bc43-415b-92b5-3c2dfd4145d0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:27.215702 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9fedb22e-4558-46b1-b7ec-87112c83d388 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:27.215828 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d15fa86d-bc43-415b-92b5-3c2dfd4145d0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:27.216509 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d15fa86d-bc43-415b-92b5-3c2dfd4145d0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:27.216627 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9fedb22e-4558-46b1-b7ec-87112c83d388 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:27.216939 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d15fa86d-bc43-415b-92b5-3c2dfd4145d0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:27.217055 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9fedb22e-4558-46b1-b7ec-87112c83d388 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:27.297699 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-d15fa86d-bc43-415b-92b5-3c2dfd4145d0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lazy-loading 'services' on Instance uuid 4adfbcc5-a227-49b4-aea6-24a58adcbd78 {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:35:27.342165 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-9fedb22e-4558-46b1-b7ec-87112c83d388 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:27.348195 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-9fedb22e-4558-46b1-b7ec-87112c83d388 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:27.349726 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-9fedb22e-4558-46b1-b7ec-87112c83d388 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:27.350865 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-9fedb22e-4558-46b1-b7ec-87112c83d388 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1730 microversion: 2.20 time: 0.146385 Oct 12 18:35:27.351421 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 601/1201] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:35:27 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:35:27.547341 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d15fa86d-bc43-415b-92b5-3c2dfd4145d0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/os-volume_attachments/0fe1c23b-a2ad-4e06-87c3-c04e5f5814a2" status: 202 len: 0 microversion: 2.1 time: 0.342249 Oct 12 18:35:27.547922 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 601/1202] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Oct 12 18:35:27 2021] DELETE /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/os-volume_attachments/0fe1c23b-a2ad-4e06-87c3-c04e5f5814a2 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 18:35:28.369536 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-5d1cdff6-3e44-47ef-8ca4-f13aa4e83360 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:28.370065 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-5d1cdff6-3e44-47ef-8ca4-f13aa4e83360 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:28.376468 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5d1cdff6-3e44-47ef-8ca4-f13aa4e83360 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:28.376916 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5d1cdff6-3e44-47ef-8ca4-f13aa4e83360 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:28.377675 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5d1cdff6-3e44-47ef-8ca4-f13aa4e83360 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:28.378107 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5d1cdff6-3e44-47ef-8ca4-f13aa4e83360 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:28.506512 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-5d1cdff6-3e44-47ef-8ca4-f13aa4e83360 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:28.517397 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-5d1cdff6-3e44-47ef-8ca4-f13aa4e83360 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:28.519129 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-5d1cdff6-3e44-47ef-8ca4-f13aa4e83360 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:28.520702 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-5d1cdff6-3e44-47ef-8ca4-f13aa4e83360 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1730 microversion: 2.20 time: 0.154977 Oct 12 18:35:28.521591 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 602/1203] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:35:28 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:35:29.541012 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3d6a8e8e-d440-420c-90a7-ef063bc780ac tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:29.541762 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3d6a8e8e-d440-420c-90a7-ef063bc780ac tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:29.548275 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3d6a8e8e-d440-420c-90a7-ef063bc780ac tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:29.548757 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3d6a8e8e-d440-420c-90a7-ef063bc780ac tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:29.549527 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3d6a8e8e-d440-420c-90a7-ef063bc780ac tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:29.549964 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3d6a8e8e-d440-420c-90a7-ef063bc780ac tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:29.680487 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3d6a8e8e-d440-420c-90a7-ef063bc780ac tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:29.689102 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3d6a8e8e-d440-420c-90a7-ef063bc780ac tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:29.691567 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3d6a8e8e-d440-420c-90a7-ef063bc780ac tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:29.693044 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3d6a8e8e-d440-420c-90a7-ef063bc780ac tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1730 microversion: 2.20 time: 0.156062 Oct 12 18:35:29.695039 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 602/1204] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:35:29 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:35:29.750823 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-a085a2ec-7398-4fc2-9bd1-4bcfaa1672b2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:29.755501 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-a085a2ec-7398-4fc2-9bd1-4bcfaa1672b2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:29.757736 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a085a2ec-7398-4fc2-9bd1-4bcfaa1672b2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:29.758173 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a085a2ec-7398-4fc2-9bd1-4bcfaa1672b2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:29.759005 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a085a2ec-7398-4fc2-9bd1-4bcfaa1672b2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:29.759436 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a085a2ec-7398-4fc2-9bd1-4bcfaa1672b2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:29.788559 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-a085a2ec-7398-4fc2-9bd1-4bcfaa1672b2 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041537 Oct 12 18:35:29.789101 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 603/1205] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Oct 12 18:35:29 2021] GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:35:30.323008 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e9b10e2a-b5e3-4548-909b-f99801df5847 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-829362155", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-800000789", "security_groups": [{"name": "tempest-secgroup-smoke-1773849625"}], "block_device_mapping_v2": [{"uuid": "f22fcd43-f495-42af-bc92-6b230cf58ea7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "61bc6454-3943-4ea7-a052-57599eadac06"}]}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:35:30.418147 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.network.neutron [None req-e9b10e2a-b5e3-4548-909b-f99801df5847 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] validate_networks() for [('61bc6454-3943-4ea7-a052-57599eadac06', None, None, None, None, None)] {{(pid=109168) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 18:35:30.611833 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-f93b3362-3ce2-4ea9-a775-cd947cb67c1d req-cf2a080c-d41e-4ad6-90b4-ac5a73ca8e2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a73458df-c845-4c48-9839-58d3acdfd4da", "name": "network-vif-plugged", "status": "completed", "tag": "6b4b7683-8980-4bd3-9e9f-66f9276cb054"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:35:30.613442 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:35:30.613442 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:35:30.620465 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-f93b3362-3ce2-4ea9-a775-cd947cb67c1d req-cf2a080c-d41e-4ad6-90b4-ac5a73ca8e2b service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:30.620903 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-f93b3362-3ce2-4ea9-a775-cd947cb67c1d req-cf2a080c-d41e-4ad6-90b4-ac5a73ca8e2b service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:30.637901 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-f93b3362-3ce2-4ea9-a775-cd947cb67c1d req-cf2a080c-d41e-4ad6-90b4-ac5a73ca8e2b service nova] Creating event network-vif-plugged:6b4b7683-8980-4bd3-9e9f-66f9276cb054 for instance a73458df-c845-4c48-9839-58d3acdfd4da on hv-cinder-81322 Oct 12 18:35:30.643032 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-f93b3362-3ce2-4ea9-a775-cd947cb67c1d req-cf2a080c-d41e-4ad6-90b4-ac5a73ca8e2b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034709 Oct 12 18:35:30.643632 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 604/1206] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:35:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:35:30.730197 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-200a69ea-19f4-464d-a593-a71dece1ccfa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:30.730197 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-200a69ea-19f4-464d-a593-a71dece1ccfa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:30.730197 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-200a69ea-19f4-464d-a593-a71dece1ccfa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:30.730197 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-200a69ea-19f4-464d-a593-a71dece1ccfa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:30.730853 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-200a69ea-19f4-464d-a593-a71dece1ccfa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:30.730853 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-200a69ea-19f4-464d-a593-a71dece1ccfa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:30.851479 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-e9b10e2a-b5e3-4548-909b-f99801df5847 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Flavor limits 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 18:35:30.851977 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-e9b10e2a-b5e3-4548-909b-f99801df5847 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Image limits 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 18:35:30.852385 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-e9b10e2a-b5e3-4548-909b-f99801df5847 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Flavor pref 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 18:35:30.852861 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-e9b10e2a-b5e3-4548-909b-f99801df5847 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Image pref 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 18:35:30.853269 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-e9b10e2a-b5e3-4548-909b-f99801df5847 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 18:35:30.863463 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e9b10e2a-b5e3-4548-909b-f99801df5847 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:30.864330 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e9b10e2a-b5e3-4548-909b-f99801df5847 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:30.865626 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e9b10e2a-b5e3-4548-909b-f99801df5847 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:30.866119 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e9b10e2a-b5e3-4548-909b-f99801df5847 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:30.883075 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-e9b10e2a-b5e3-4548-909b-f99801df5847 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Getting quotas for project d1b808c36ccd4256858530aedc0a6f64. Resources: {'instances', 'cores', 'ram'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:35:30.887197 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-e9b10e2a-b5e3-4548-909b-f99801df5847 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Getting quotas for user 9a37985dd5034ceeabfa47797efba5a1 and project d1b808c36ccd4256858530aedc0a6f64. Resources: {'instances', 'cores', 'ram'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:35:30.892816 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-200a69ea-19f4-464d-a593-a71dece1ccfa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:30.895479 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-200a69ea-19f4-464d-a593-a71dece1ccfa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:30.897021 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-200a69ea-19f4-464d-a593-a71dece1ccfa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:30.898211 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-200a69ea-19f4-464d-a593-a71dece1ccfa tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1730 microversion: 2.20 time: 0.189573 Oct 12 18:35:30.898772 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 605/1207] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:35:30 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:35:30.903510 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-1292863d-ee2e-43d9-8c0c-3f33b21251ad tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:30.905240 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-1292863d-ee2e-43d9-8c0c-3f33b21251ad tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:30.916600 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1292863d-ee2e-43d9-8c0c-3f33b21251ad tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:30.917412 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1292863d-ee2e-43d9-8c0c-3f33b21251ad tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:30.924933 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1292863d-ee2e-43d9-8c0c-3f33b21251ad tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:30.924933 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1292863d-ee2e-43d9-8c0c-3f33b21251ad tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:30.945133 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e9b10e2a-b5e3-4548-909b-f99801df5847 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Going to run 1 instances... {{(pid=109168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 18:35:30.947343 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e9b10e2a-b5e3-4548-909b-f99801df5847 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f22fcd43-f495-42af-bc92-6b230cf58ea7',volume_size=None,volume_type=None)] {{(pid=109168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 18:35:30.950967 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-1292863d-ee2e-43d9-8c0c-3f33b21251ad tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051114 Oct 12 18:35:30.951640 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 606/1208] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Oct 12 18:35:30 2021] GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 18:35:31.025341 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-f7e25b99-048d-4e38-ab96-a0792667852a tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:31.025341 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-f7e25b99-048d-4e38-ab96-a0792667852a tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: 220439aa-4c2e-48cd-8704-e6bc6f3e9ebf] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:31.030907 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f7e25b99-048d-4e38-ab96-a0792667852a tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:31.031426 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f7e25b99-048d-4e38-ab96-a0792667852a tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:31.032272 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f7e25b99-048d-4e38-ab96-a0792667852a tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:31.032970 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f7e25b99-048d-4e38-ab96-a0792667852a tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:31.111833 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.objects.instance [None req-f7e25b99-048d-4e38-ab96-a0792667852a tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lazy-loading 'services' on Instance uuid 220439aa-4c2e-48cd-8704-e6bc6f3e9ebf {{(pid=109169) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:35:31.297695 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-f7e25b99-048d-4e38-ab96-a0792667852a tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "DELETE /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf/os-volume_attachments/4ff5b881-6d77-4b7d-ae17-b0c514d362ce" status: 202 len: 0 microversion: 2.1 time: 0.278354 Oct 12 18:35:31.301569 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 607/1209] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Oct 12 18:35:31 2021] DELETE /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf/os-volume_attachments/4ff5b881-6d77-4b7d-ae17-b0c514d362ce => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:35:31.306674 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-0222a605-3d59-48d4-b963-72db5dd8ac2c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:31.307775 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-0222a605-3d59-48d4-b963-72db5dd8ac2c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:31.314105 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0222a605-3d59-48d4-b963-72db5dd8ac2c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:31.314549 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0222a605-3d59-48d4-b963-72db5dd8ac2c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:31.315311 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0222a605-3d59-48d4-b963-72db5dd8ac2c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:31.315739 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0222a605-3d59-48d4-b963-72db5dd8ac2c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:31.346336 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-0222a605-3d59-48d4-b963-72db5dd8ac2c tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046891 Oct 12 18:35:31.346903 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 608/1210] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Oct 12 18:35:31 2021] GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 18:35:31.375853 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e9b10e2a-b5e3-4548-909b-f99801df5847 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [e8197312-3ec2-47aa-b20e-362bc2d720f0] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 18:35:31.402128 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-577fd955-6baf-4153-b367-643f42a76828 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:31.404551 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-577fd955-6baf-4153-b367-643f42a76828 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:31.409201 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-577fd955-6baf-4153-b367-643f42a76828 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:31.409640 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-577fd955-6baf-4153-b367-643f42a76828 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:31.410432 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-577fd955-6baf-4153-b367-643f42a76828 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:31.410801 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-577fd955-6baf-4153-b367-643f42a76828 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:31.434567 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-577fd955-6baf-4153-b367-643f42a76828 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Going to try to terminate instance {{(pid=109169) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 18:35:31.744369 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-577fd955-6baf-4153-b367-643f42a76828 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78" status: 204 len: 0 microversion: 2.1 time: 0.345483 Oct 12 18:35:31.744994 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 609/1211] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Oct 12 18:35:31 2021] DELETE /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 18:35:31.753563 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-691db28c-191f-4788-bd3d-eee0b8f54cf7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:31.754237 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-691db28c-191f-4788-bd3d-eee0b8f54cf7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:31.760229 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-691db28c-191f-4788-bd3d-eee0b8f54cf7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:31.768797 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-691db28c-191f-4788-bd3d-eee0b8f54cf7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:31.768797 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-691db28c-191f-4788-bd3d-eee0b8f54cf7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:31.768797 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-691db28c-191f-4788-bd3d-eee0b8f54cf7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:31.885659 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-691db28c-191f-4788-bd3d-eee0b8f54cf7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:31.893670 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-691db28c-191f-4788-bd3d-eee0b8f54cf7 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78" status: 200 len: 1673 microversion: 2.1 time: 0.143806 Oct 12 18:35:31.894349 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 610/1212] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:31 2021] GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78 => generated 1673 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:35:31.917102 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-580a4177-517d-40b4-abac-a7ef0c80697e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:31.917783 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-580a4177-517d-40b4-abac-a7ef0c80697e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:31.924009 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-580a4177-517d-40b4-abac-a7ef0c80697e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:31.924475 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-580a4177-517d-40b4-abac-a7ef0c80697e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:31.925225 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-580a4177-517d-40b4-abac-a7ef0c80697e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:31.925648 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-580a4177-517d-40b4-abac-a7ef0c80697e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:32.046796 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-580a4177-517d-40b4-abac-a7ef0c80697e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:32.054469 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-580a4177-517d-40b4-abac-a7ef0c80697e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:32.055952 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-580a4177-517d-40b4-abac-a7ef0c80697e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:32.057133 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-580a4177-517d-40b4-abac-a7ef0c80697e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1730 microversion: 2.20 time: 0.143583 Oct 12 18:35:32.057691 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 611/1213] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:35:31 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1730 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:35:32.393235 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO oslo.messaging._drivers.impl_rabbit [None req-e9b10e2a-b5e3-4548-909b-f99801df5847 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [e8197312-3ec2-47aa-b20e-362bc2d720f0] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 42674. Oct 12 18:35:32.397430 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e9b10e2a-b5e3-4548-909b-f99801df5847 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.078017 Oct 12 18:35:32.398253 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 603/1214] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Oct 12 18:35:30 2021] POST /compute/v2.1/servers => generated 406 bytes in 2079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 18:35:32.413590 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-179cff69-3744-4c7c-84aa-01e76f38b65f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:32.414210 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-179cff69-3744-4c7c-84aa-01e76f38b65f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:32.470078 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-179cff69-3744-4c7c-84aa-01e76f38b65f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:32.476716 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-179cff69-3744-4c7c-84aa-01e76f38b65f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7" status: 200 len: 1093 microversion: 2.1 time: 0.066880 Oct 12 18:35:32.478506 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 612/1215] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:32 2021] GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:35:32.911172 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a4f6fbec-7a31-44ac-9f45-2e8bca8df858 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:32.911850 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a4f6fbec-7a31-44ac-9f45-2e8bca8df858 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:32.917768 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a4f6fbec-7a31-44ac-9f45-2e8bca8df858 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:32.918212 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a4f6fbec-7a31-44ac-9f45-2e8bca8df858 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:32.918977 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a4f6fbec-7a31-44ac-9f45-2e8bca8df858 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:32.919410 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a4f6fbec-7a31-44ac-9f45-2e8bca8df858 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:33.046863 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a4f6fbec-7a31-44ac-9f45-2e8bca8df858 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:33.054026 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a4f6fbec-7a31-44ac-9f45-2e8bca8df858 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78" status: 200 len: 1673 microversion: 2.1 time: 0.146649 Oct 12 18:35:33.056487 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 604/1216] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:32 2021] GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78 => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:35:33.074726 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-422559d8-7a5c-4324-8316-ba7f12360f5a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:33.075330 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-422559d8-7a5c-4324-8316-ba7f12360f5a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:33.081960 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-422559d8-7a5c-4324-8316-ba7f12360f5a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:33.082406 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-422559d8-7a5c-4324-8316-ba7f12360f5a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:33.083162 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-422559d8-7a5c-4324-8316-ba7f12360f5a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:33.083595 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-422559d8-7a5c-4324-8316-ba7f12360f5a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:33.205841 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-422559d8-7a5c-4324-8316-ba7f12360f5a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:33.213700 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-422559d8-7a5c-4324-8316-ba7f12360f5a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:33.215195 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-422559d8-7a5c-4324-8316-ba7f12360f5a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:33.216388 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-422559d8-7a5c-4324-8316-ba7f12360f5a tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1730 microversion: 2.20 time: 0.145359 Oct 12 18:35:33.216961 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 613/1217] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:35:33 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1730 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:35:33.456026 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a75e43da-2354-4dff-b120-d7b4c2967e6b tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:33.456592 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a75e43da-2354-4dff-b120-d7b4c2967e6b tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: 220439aa-4c2e-48cd-8704-e6bc6f3e9ebf] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:33.462220 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a75e43da-2354-4dff-b120-d7b4c2967e6b tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:33.462661 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a75e43da-2354-4dff-b120-d7b4c2967e6b tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:33.463513 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a75e43da-2354-4dff-b120-d7b4c2967e6b tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:33.464124 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a75e43da-2354-4dff-b120-d7b4c2967e6b tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:33.488366 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a75e43da-2354-4dff-b120-d7b4c2967e6b tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: 220439aa-4c2e-48cd-8704-e6bc6f3e9ebf] Going to try to terminate instance {{(pid=109168) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 18:35:33.494392 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-6f08f93c-9aa8-497c-9de5-fc7f98d51271 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:33.494989 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-6f08f93c-9aa8-497c-9de5-fc7f98d51271 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:33.501619 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6f08f93c-9aa8-497c-9de5-fc7f98d51271 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:33.502003 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6f08f93c-9aa8-497c-9de5-fc7f98d51271 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:33.502763 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6f08f93c-9aa8-497c-9de5-fc7f98d51271 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:33.503365 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6f08f93c-9aa8-497c-9de5-fc7f98d51271 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:33.565359 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-6f08f93c-9aa8-497c-9de5-fc7f98d51271 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:33.573093 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-6f08f93c-9aa8-497c-9de5-fc7f98d51271 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7" status: 200 len: 1143 microversion: 2.1 time: 0.082287 Oct 12 18:35:33.573685 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 614/1218] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:33 2021] GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:35:33.859607 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a75e43da-2354-4dff-b120-d7b4c2967e6b tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "DELETE /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf" status: 204 len: 0 microversion: 2.1 time: 0.406976 Oct 12 18:35:33.860188 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 605/1219] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Oct 12 18:35:33 2021] DELETE /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 18:35:33.867935 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-135d3e6f-c398-4a8c-9fa4-cc546600694c tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:33.868572 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-135d3e6f-c398-4a8c-9fa4-cc546600694c tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: 220439aa-4c2e-48cd-8704-e6bc6f3e9ebf] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:33.874284 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-135d3e6f-c398-4a8c-9fa4-cc546600694c tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:33.874716 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-135d3e6f-c398-4a8c-9fa4-cc546600694c tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:33.875488 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-135d3e6f-c398-4a8c-9fa4-cc546600694c tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:33.875912 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-135d3e6f-c398-4a8c-9fa4-cc546600694c tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:34.012750 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-135d3e6f-c398-4a8c-9fa4-cc546600694c tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:34.019924 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-135d3e6f-c398-4a8c-9fa4-cc546600694c tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf" status: 200 len: 1513 microversion: 2.1 time: 0.155597 Oct 12 18:35:34.020515 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 615/1220] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:33 2021] GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:35:34.072267 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0e4cfbaa-6bf8-4216-883b-1e76aa00dfa3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:34.073008 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0e4cfbaa-6bf8-4216-883b-1e76aa00dfa3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:34.078752 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0e4cfbaa-6bf8-4216-883b-1e76aa00dfa3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:34.079301 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0e4cfbaa-6bf8-4216-883b-1e76aa00dfa3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:34.080070 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0e4cfbaa-6bf8-4216-883b-1e76aa00dfa3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:34.080527 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0e4cfbaa-6bf8-4216-883b-1e76aa00dfa3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:34.206479 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0e4cfbaa-6bf8-4216-883b-1e76aa00dfa3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:34.213840 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0e4cfbaa-6bf8-4216-883b-1e76aa00dfa3 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78" status: 200 len: 1673 microversion: 2.1 time: 0.145574 Oct 12 18:35:34.214404 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 606/1221] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:34 2021] GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78 => generated 1673 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:35:34.234718 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-5a7e3959-68a4-4a78-8e8a-47e183cfe1d9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:34.235296 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-5a7e3959-68a4-4a78-8e8a-47e183cfe1d9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:34.242095 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5a7e3959-68a4-4a78-8e8a-47e183cfe1d9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:34.242557 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5a7e3959-68a4-4a78-8e8a-47e183cfe1d9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:34.243301 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5a7e3959-68a4-4a78-8e8a-47e183cfe1d9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:34.243725 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5a7e3959-68a4-4a78-8e8a-47e183cfe1d9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:34.366144 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-5a7e3959-68a4-4a78-8e8a-47e183cfe1d9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:34.374073 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-5a7e3959-68a4-4a78-8e8a-47e183cfe1d9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:34.375588 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-5a7e3959-68a4-4a78-8e8a-47e183cfe1d9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:34.377099 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-5a7e3959-68a4-4a78-8e8a-47e183cfe1d9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1717 microversion: 2.20 time: 0.145870 Oct 12 18:35:34.377332 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 616/1222] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:35:34 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1717 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:35:34.590113 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ab88352b-dad8-4fe4-9930-4ab006c0f844 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:34.590737 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ab88352b-dad8-4fe4-9930-4ab006c0f844 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:34.596532 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ab88352b-dad8-4fe4-9930-4ab006c0f844 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:34.596982 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ab88352b-dad8-4fe4-9930-4ab006c0f844 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:34.597759 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ab88352b-dad8-4fe4-9930-4ab006c0f844 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:34.598191 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ab88352b-dad8-4fe4-9930-4ab006c0f844 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:34.879860 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ab88352b-dad8-4fe4-9930-4ab006c0f844 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:34.887094 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ab88352b-dad8-4fe4-9930-4ab006c0f844 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7" status: 200 len: 1191 microversion: 2.1 time: 0.300746 Oct 12 18:35:34.887765 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 607/1223] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:34 2021] GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 => generated 1191 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:35:35.038372 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-905ba54e-760f-47af-a462-22d5e4d97451 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:35.039288 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-905ba54e-760f-47af-a462-22d5e4d97451 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: 220439aa-4c2e-48cd-8704-e6bc6f3e9ebf] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:35.046474 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-905ba54e-760f-47af-a462-22d5e4d97451 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:35.046474 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-905ba54e-760f-47af-a462-22d5e4d97451 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:35.047150 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-905ba54e-760f-47af-a462-22d5e4d97451 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:35.047585 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-905ba54e-760f-47af-a462-22d5e4d97451 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:35.230812 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-abcde0bf-7a4a-43cb-b1df-32d8164c9ae0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:35.231614 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-abcde0bf-7a4a-43cb-b1df-32d8164c9ae0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:35.238422 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-abcde0bf-7a4a-43cb-b1df-32d8164c9ae0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:35.239007 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-abcde0bf-7a4a-43cb-b1df-32d8164c9ae0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:35.239839 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-abcde0bf-7a4a-43cb-b1df-32d8164c9ae0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:35.240352 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-abcde0bf-7a4a-43cb-b1df-32d8164c9ae0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:35.352562 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-905ba54e-760f-47af-a462-22d5e4d97451 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:35.360599 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-905ba54e-760f-47af-a462-22d5e4d97451 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf" status: 200 len: 1513 microversion: 2.1 time: 0.325763 Oct 12 18:35:35.361234 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 617/1224] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:35 2021] GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf => generated 1513 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:35:35.413373 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-abcde0bf-7a4a-43cb-b1df-32d8164c9ae0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:35.421494 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-abcde0bf-7a4a-43cb-b1df-32d8164c9ae0 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78" status: 200 len: 1673 microversion: 2.1 time: 0.194338 Oct 12 18:35:35.422067 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 608/1225] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:35 2021] GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78 => generated 1673 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:35:35.906750 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-534885cb-0dd7-48c3-ab1f-78f9fc5a5ac6 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:35.907584 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-534885cb-0dd7-48c3-ab1f-78f9fc5a5ac6 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:35.918546 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-534885cb-0dd7-48c3-ab1f-78f9fc5a5ac6 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:35.918546 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-534885cb-0dd7-48c3-ab1f-78f9fc5a5ac6 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:35.918546 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-534885cb-0dd7-48c3-ab1f-78f9fc5a5ac6 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:35.918546 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-534885cb-0dd7-48c3-ab1f-78f9fc5a5ac6 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:35.948236 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-2d0ff613-3e8b-4ea7-91fe-92a2be20e478 req-6b152c22-37c4-4582-8af1-28c96c4c40b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4adfbcc5-a227-49b4-aea6-24a58adcbd78", "name": "network-vif-deleted", "tag": "5768eef0-c768-4c9b-af39-569bde13629c"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:35:35.950151 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:35:35.950151 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:35:35.975630 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-2d0ff613-3e8b-4ea7-91fe-92a2be20e478 req-6b152c22-37c4-4582-8af1-28c96c4c40b9 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:35.978632 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-2d0ff613-3e8b-4ea7-91fe-92a2be20e478 req-6b152c22-37c4-4582-8af1-28c96c4c40b9 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:36.011522 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-2d0ff613-3e8b-4ea7-91fe-92a2be20e478 req-6b152c22-37c4-4582-8af1-28c96c4c40b9 service nova] Creating event network-vif-deleted:5768eef0-c768-4c9b-af39-569bde13629c for instance 4adfbcc5-a227-49b4-aea6-24a58adcbd78 on hv-cinder-81322 Oct 12 18:35:36.017465 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-2d0ff613-3e8b-4ea7-91fe-92a2be20e478 req-6b152c22-37c4-4582-8af1-28c96c4c40b9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073941 Oct 12 18:35:36.018730 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 609/1226] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:35:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 18:35:36.301308 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-534885cb-0dd7-48c3-ab1f-78f9fc5a5ac6 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:36.308814 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-534885cb-0dd7-48c3-ab1f-78f9fc5a5ac6 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7" status: 200 len: 1277 microversion: 2.1 time: 0.406734 Oct 12 18:35:36.322040 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 618/1227] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:35 2021] GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 => generated 1277 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:35:36.378975 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-388e6c9e-a919-499b-a2df-8f952f6a6ba3 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:36.380140 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-388e6c9e-a919-499b-a2df-8f952f6a6ba3 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: 220439aa-4c2e-48cd-8704-e6bc6f3e9ebf] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:36.387751 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-388e6c9e-a919-499b-a2df-8f952f6a6ba3 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:36.389205 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-388e6c9e-a919-499b-a2df-8f952f6a6ba3 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:36.390309 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-388e6c9e-a919-499b-a2df-8f952f6a6ba3 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:36.391105 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-388e6c9e-a919-499b-a2df-8f952f6a6ba3 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:36.439227 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-96a9da92-2ff0-4076-8ede-9a6f069e5492 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:36.439836 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-96a9da92-2ff0-4076-8ede-9a6f069e5492 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:36.448846 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-96a9da92-2ff0-4076-8ede-9a6f069e5492 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:36.449122 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-96a9da92-2ff0-4076-8ede-9a6f069e5492 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:36.450083 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-96a9da92-2ff0-4076-8ede-9a6f069e5492 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:36.450700 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-96a9da92-2ff0-4076-8ede-9a6f069e5492 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:36.490331 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-96a9da92-2ff0-4076-8ede-9a6f069e5492 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:36.490793 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-96a9da92-2ff0-4076-8ede-9a6f069e5492 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:36.491941 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.objects.instance [None req-96a9da92-2ff0-4076-8ede-9a6f069e5492 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lazy-loading 'fault' on Instance uuid 4adfbcc5-a227-49b4-aea6-24a58adcbd78 {{(pid=109169) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:35:36.595621 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-96a9da92-2ff0-4076-8ede-9a6f069e5492 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835bbb43ae5f48bfa14b22cb0a47cb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee04649277c84912b20967b31162615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:36.614035 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-96a9da92-2ff0-4076-8ede-9a6f069e5492 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78" status: 200 len: 1327 microversion: 2.1 time: 0.177591 Oct 12 18:35:36.615701 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 619/1228] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:36 2021] GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78 => generated 1327 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:35:36.677600 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-705f159e-3500-4e61-bc7b-d0e71bff4c04 req-c2fc175f-b58d-4a18-9cae-8d725f804b6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "220439aa-4c2e-48cd-8704-e6bc6f3e9ebf", "name": "network-vif-deleted", "tag": "0452dd24-8e0a-42a0-80df-409da03aecd6"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:35:36.679673 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:35:36.679673 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:35:36.688149 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-705f159e-3500-4e61-bc7b-d0e71bff4c04 req-c2fc175f-b58d-4a18-9cae-8d725f804b6b service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:36.688706 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-705f159e-3500-4e61-bc7b-d0e71bff4c04 req-c2fc175f-b58d-4a18-9cae-8d725f804b6b service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:36.699856 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-705f159e-3500-4e61-bc7b-d0e71bff4c04 req-c2fc175f-b58d-4a18-9cae-8d725f804b6b service nova] Creating event network-vif-deleted:0452dd24-8e0a-42a0-80df-409da03aecd6 for instance 220439aa-4c2e-48cd-8704-e6bc6f3e9ebf on hv-cinder-81322 Oct 12 18:35:36.705801 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-705f159e-3500-4e61-bc7b-d0e71bff4c04 req-c2fc175f-b58d-4a18-9cae-8d725f804b6b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031785 Oct 12 18:35:36.706913 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 620/1229] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:35:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 18:35:36.733449 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-388e6c9e-a919-499b-a2df-8f952f6a6ba3 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:36.741389 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-388e6c9e-a919-499b-a2df-8f952f6a6ba3 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf" status: 200 len: 1513 microversion: 2.1 time: 0.366638 Oct 12 18:35:36.742674 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 610/1230] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:36 2021] GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf => generated 1513 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:35:37.339350 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-9492b002-3f9a-42bc-a4dc-71d100cd7870 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:37.340238 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-9492b002-3f9a-42bc-a4dc-71d100cd7870 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:37.347182 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9492b002-3f9a-42bc-a4dc-71d100cd7870 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:37.348128 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9492b002-3f9a-42bc-a4dc-71d100cd7870 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:37.349154 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9492b002-3f9a-42bc-a4dc-71d100cd7870 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:37.349804 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9492b002-3f9a-42bc-a4dc-71d100cd7870 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:37.517608 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-9492b002-3f9a-42bc-a4dc-71d100cd7870 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:37.526397 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-9492b002-3f9a-42bc-a4dc-71d100cd7870 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7" status: 200 len: 1265 microversion: 2.1 time: 0.190793 Oct 12 18:35:37.527312 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 621/1231] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:37 2021] GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:35:37.635722 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3fdefb3d-5ad0-46dd-9127-96b34974c677 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:37.640605 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3fdefb3d-5ad0-46dd-9127-96b34974c677 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:37.646251 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3fdefb3d-5ad0-46dd-9127-96b34974c677 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:37.646798 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3fdefb3d-5ad0-46dd-9127-96b34974c677 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:37.647613 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3fdefb3d-5ad0-46dd-9127-96b34974c677 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:37.648044 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3fdefb3d-5ad0-46dd-9127-96b34974c677 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:37.662638 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-3fdefb3d-5ad0-46dd-9127-96b34974c677 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] HTTP exception thrown: Instance 4adfbcc5-a227-49b4-aea6-24a58adcbd78 could not be found. Oct 12 18:35:37.663236 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3fdefb3d-5ad0-46dd-9127-96b34974c677 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Returning 404 to user: Instance 4adfbcc5-a227-49b4-aea6-24a58adcbd78 could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:35:37.664071 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3fdefb3d-5ad0-46dd-9127-96b34974c677 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78" status: 404 len: 111 microversion: 2.1 time: 0.036213 Oct 12 18:35:37.668338 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 611/1232] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:37 2021] GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:35:37.673301 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-4dd89fd4-4456-458d-89b8-6373c8dac0d6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '.version_select at 0x7fe297d95b80>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:37.761647 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-31f72ffa-aac4-412e-b1e6-959e4d5a7ae4 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:37.762285 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-31f72ffa-aac4-412e-b1e6-959e4d5a7ae4 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: 220439aa-4c2e-48cd-8704-e6bc6f3e9ebf] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:37.769008 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-31f72ffa-aac4-412e-b1e6-959e4d5a7ae4 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:37.774396 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-31f72ffa-aac4-412e-b1e6-959e4d5a7ae4 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:37.774396 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-31f72ffa-aac4-412e-b1e6-959e4d5a7ae4 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:37.774396 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-31f72ffa-aac4-412e-b1e6-959e4d5a7ae4 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:37.788974 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-4dd89fd4-4456-458d-89b8-6373c8dac0d6 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-381517377" status: 202 len: 0 microversion: 2.1 time: 0.119488 Oct 12 18:35:37.790024 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 622/1233] 10.222.0.18 () {58 vars in 1217 bytes} [Tue Oct 12 18:35:37 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-381517377 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:35:37.804264 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-31f72ffa-aac4-412e-b1e6-959e4d5a7ae4 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:37.804786 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-31f72ffa-aac4-412e-b1e6-959e4d5a7ae4 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:37.805238 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-31f72ffa-aac4-412e-b1e6-959e4d5a7ae4 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lazy-loading 'fault' on Instance uuid 220439aa-4c2e-48cd-8704-e6bc6f3e9ebf {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:35:37.858050 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-31f72ffa-aac4-412e-b1e6-959e4d5a7ae4 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa8dff1ca444f081caa0cd1b4be6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec087a3edc444cbb249442bb987326c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:37.864712 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-31f72ffa-aac4-412e-b1e6-959e4d5a7ae4 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf" status: 200 len: 1309 microversion: 2.1 time: 0.106636 Oct 12 18:35:37.865519 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 612/1234] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:37 2021] GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf => generated 1309 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:35:38.060945 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-c0a496b5-ee9c-4548-95a3-6f1c0a1be5d0 req-7560f76f-35c9-4485-ada6-738491c5232b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7", "tag": "6b64a2da-1847-42d7-b301-103470a2877a"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:35:38.060945 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:35:38.060945 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:35:38.071863 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-c0a496b5-ee9c-4548-95a3-6f1c0a1be5d0 req-7560f76f-35c9-4485-ada6-738491c5232b service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:38.072769 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-c0a496b5-ee9c-4548-95a3-6f1c0a1be5d0 req-7560f76f-35c9-4485-ada6-738491c5232b service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:38.085453 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-c0a496b5-ee9c-4548-95a3-6f1c0a1be5d0 req-7560f76f-35c9-4485-ada6-738491c5232b service nova] Creating event network-changed:6b64a2da-1847-42d7-b301-103470a2877a for instance 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 on hv-cinder-81322 Oct 12 18:35:38.092502 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-c0a496b5-ee9c-4548-95a3-6f1c0a1be5d0 req-7560f76f-35c9-4485-ada6-738491c5232b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036373 Oct 12 18:35:38.093468 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 623/1235] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:35:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 18:35:38.545071 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-992cc2fc-abab-4285-9351-5ca1f9d9bc8b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:38.546009 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-992cc2fc-abab-4285-9351-5ca1f9d9bc8b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:38.552049 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-992cc2fc-abab-4285-9351-5ca1f9d9bc8b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:38.552536 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-992cc2fc-abab-4285-9351-5ca1f9d9bc8b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:38.553334 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-992cc2fc-abab-4285-9351-5ca1f9d9bc8b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:38.553768 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-992cc2fc-abab-4285-9351-5ca1f9d9bc8b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:38.811479 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-992cc2fc-abab-4285-9351-5ca1f9d9bc8b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:38.819358 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-992cc2fc-abab-4285-9351-5ca1f9d9bc8b tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7" status: 200 len: 1265 microversion: 2.1 time: 0.278480 Oct 12 18:35:38.819949 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 613/1236] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:38 2021] GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 => generated 1265 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:35:38.883588 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-cff440c2-96c2-4606-be9b-25603ff3f930 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:38.884426 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-cff440c2-96c2-4606-be9b-25603ff3f930 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] [instance: 220439aa-4c2e-48cd-8704-e6bc6f3e9ebf] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:38.891976 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cff440c2-96c2-4606-be9b-25603ff3f930 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:38.892971 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cff440c2-96c2-4606-be9b-25603ff3f930 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:38.893524 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cff440c2-96c2-4606-be9b-25603ff3f930 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:38.894085 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cff440c2-96c2-4606-be9b-25603ff3f930 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:38.914337 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.wsgi [None req-cff440c2-96c2-4606-be9b-25603ff3f930 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] HTTP exception thrown: Instance 220439aa-4c2e-48cd-8704-e6bc6f3e9ebf could not be found. Oct 12 18:35:38.915008 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-cff440c2-96c2-4606-be9b-25603ff3f930 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] Returning 404 to user: Instance 220439aa-4c2e-48cd-8704-e6bc6f3e9ebf could not be found. {{(pid=109169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:35:38.915924 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-cff440c2-96c2-4606-be9b-25603ff3f930 tempest-VolumesSnapshotTestJSON-1319049793 tempest-VolumesSnapshotTestJSON-1319049793-project] 10.222.0.18 "GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf" status: 404 len: 111 microversion: 2.1 time: 0.036531 Oct 12 18:35:38.916609 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 624/1237] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:38 2021] GET /compute/v2.1/servers/220439aa-4c2e-48cd-8704-e6bc6f3e9ebf => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:35:39.836391 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4c04f0f1-bc9a-4088-9cad-2bfec6490ad2 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:39.837020 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4c04f0f1-bc9a-4088-9cad-2bfec6490ad2 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:39.843383 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4c04f0f1-bc9a-4088-9cad-2bfec6490ad2 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:39.843828 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4c04f0f1-bc9a-4088-9cad-2bfec6490ad2 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:39.844727 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4c04f0f1-bc9a-4088-9cad-2bfec6490ad2 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:39.845123 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4c04f0f1-bc9a-4088-9cad-2bfec6490ad2 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:39.975489 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4c04f0f1-bc9a-4088-9cad-2bfec6490ad2 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:39.983532 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4c04f0f1-bc9a-4088-9cad-2bfec6490ad2 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7" status: 200 len: 1265 microversion: 2.1 time: 0.150796 Oct 12 18:35:39.984107 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 614/1238] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:39 2021] GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:35:41.000669 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-9b173782-83ff-4e2e-9f42-48d506497887 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:41.001272 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-9b173782-83ff-4e2e-9f42-48d506497887 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:41.007182 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9b173782-83ff-4e2e-9f42-48d506497887 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:41.007615 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9b173782-83ff-4e2e-9f42-48d506497887 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:41.008379 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9b173782-83ff-4e2e-9f42-48d506497887 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:41.008824 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9b173782-83ff-4e2e-9f42-48d506497887 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:41.141849 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-9b173782-83ff-4e2e-9f42-48d506497887 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:41.149103 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-9b173782-83ff-4e2e-9f42-48d506497887 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7" status: 200 len: 1265 microversion: 2.1 time: 0.152852 Oct 12 18:35:41.149662 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 625/1239] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:40 2021] GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:35:41.235790 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-eb0c08f2-bec9-4492-a4bd-fd3996aa0aa1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:41.236319 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-eb0c08f2-bec9-4492-a4bd-fd3996aa0aa1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:41.242276 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eb0c08f2-bec9-4492-a4bd-fd3996aa0aa1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:41.242714 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eb0c08f2-bec9-4492-a4bd-fd3996aa0aa1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:41.243469 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eb0c08f2-bec9-4492-a4bd-fd3996aa0aa1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:41.243891 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eb0c08f2-bec9-4492-a4bd-fd3996aa0aa1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:41.260222 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-eb0c08f2-bec9-4492-a4bd-fd3996aa0aa1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] HTTP exception thrown: Instance 4adfbcc5-a227-49b4-aea6-24a58adcbd78 could not be found. Oct 12 18:35:41.260847 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-eb0c08f2-bec9-4492-a4bd-fd3996aa0aa1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Returning 404 to user: Instance 4adfbcc5-a227-49b4-aea6-24a58adcbd78 could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:35:41.261664 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-eb0c08f2-bec9-4492-a4bd-fd3996aa0aa1 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78" status: 404 len: 111 microversion: 2.1 time: 0.030036 Oct 12 18:35:41.262207 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 615/1240] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Oct 12 18:35:41 2021] DELETE /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:35:41.270137 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-87d04514-bd5e-4fb0-8be2-87f40e5827e9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:41.270730 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-87d04514-bd5e-4fb0-8be2-87f40e5827e9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 4adfbcc5-a227-49b4-aea6-24a58adcbd78] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:41.277032 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-87d04514-bd5e-4fb0-8be2-87f40e5827e9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:41.277470 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-87d04514-bd5e-4fb0-8be2-87f40e5827e9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:41.278344 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-87d04514-bd5e-4fb0-8be2-87f40e5827e9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:41.278774 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-87d04514-bd5e-4fb0-8be2-87f40e5827e9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:41.293494 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.wsgi [None req-87d04514-bd5e-4fb0-8be2-87f40e5827e9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] HTTP exception thrown: Instance 4adfbcc5-a227-49b4-aea6-24a58adcbd78 could not be found. Oct 12 18:35:41.294075 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-87d04514-bd5e-4fb0-8be2-87f40e5827e9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Returning 404 to user: Instance 4adfbcc5-a227-49b4-aea6-24a58adcbd78 could not be found. {{(pid=109169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:35:41.295459 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-87d04514-bd5e-4fb0-8be2-87f40e5827e9 tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78" status: 404 len: 111 microversion: 2.1 time: 0.028436 Oct 12 18:35:41.296039 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 626/1241] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:41 2021] GET /compute/v2.1/servers/4adfbcc5-a227-49b4-aea6-24a58adcbd78 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 18:35:42.165829 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1f0fa4c2-ff70-46a5-9dcf-fd7ac003347f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:42.166552 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1f0fa4c2-ff70-46a5-9dcf-fd7ac003347f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:42.172547 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1f0fa4c2-ff70-46a5-9dcf-fd7ac003347f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:42.173022 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1f0fa4c2-ff70-46a5-9dcf-fd7ac003347f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:42.173920 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1f0fa4c2-ff70-46a5-9dcf-fd7ac003347f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:42.174366 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1f0fa4c2-ff70-46a5-9dcf-fd7ac003347f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:42.290777 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1f0fa4c2-ff70-46a5-9dcf-fd7ac003347f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:42.297992 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1f0fa4c2-ff70-46a5-9dcf-fd7ac003347f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7" status: 200 len: 1265 microversion: 2.1 time: 0.135787 Oct 12 18:35:42.298548 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 616/1242] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:42 2021] GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 => generated 1265 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:35:43.314590 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-8e5b4e7c-e6db-4526-afab-45ad04c3d5fc tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:43.315187 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-8e5b4e7c-e6db-4526-afab-45ad04c3d5fc tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:43.320973 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8e5b4e7c-e6db-4526-afab-45ad04c3d5fc tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:43.321409 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8e5b4e7c-e6db-4526-afab-45ad04c3d5fc tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:43.322164 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8e5b4e7c-e6db-4526-afab-45ad04c3d5fc tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:43.322584 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8e5b4e7c-e6db-4526-afab-45ad04c3d5fc tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:43.453875 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-8e5b4e7c-e6db-4526-afab-45ad04c3d5fc tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:43.461129 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-8e5b4e7c-e6db-4526-afab-45ad04c3d5fc tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7" status: 200 len: 1265 microversion: 2.1 time: 0.150282 Oct 12 18:35:43.461700 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 627/1243] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:43 2021] GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:35:44.478906 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-03fa33a6-f93b-48ab-81a2-f7349e620bf6 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:44.479452 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-03fa33a6-f93b-48ab-81a2-f7349e620bf6 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:44.486187 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-03fa33a6-f93b-48ab-81a2-f7349e620bf6 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:44.486622 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-03fa33a6-f93b-48ab-81a2-f7349e620bf6 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:44.487375 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-03fa33a6-f93b-48ab-81a2-f7349e620bf6 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:44.487798 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-03fa33a6-f93b-48ab-81a2-f7349e620bf6 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:44.622033 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-03fa33a6-f93b-48ab-81a2-f7349e620bf6 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:44.637243 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-03fa33a6-f93b-48ab-81a2-f7349e620bf6 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7" status: 200 len: 1265 microversion: 2.1 time: 0.161981 Oct 12 18:35:44.637828 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 617/1244] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:44 2021] GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:35:45.655027 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-7e61ada1-24e4-4074-9ddc-491e4b52a13f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:45.655656 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-7e61ada1-24e4-4074-9ddc-491e4b52a13f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:45.661649 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7e61ada1-24e4-4074-9ddc-491e4b52a13f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:45.662098 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7e61ada1-24e4-4074-9ddc-491e4b52a13f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:45.662868 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7e61ada1-24e4-4074-9ddc-491e4b52a13f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:45.663306 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7e61ada1-24e4-4074-9ddc-491e4b52a13f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:45.785775 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-7e61ada1-24e4-4074-9ddc-491e4b52a13f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:45.793382 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-7e61ada1-24e4-4074-9ddc-491e4b52a13f tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7" status: 200 len: 1265 microversion: 2.1 time: 0.141945 Oct 12 18:35:45.793946 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 628/1245] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:45 2021] GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:35:46.811084 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8623b3d7-b84b-4e18-9f07-03ae3d00770c tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:46.811989 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8623b3d7-b84b-4e18-9f07-03ae3d00770c tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:46.817730 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8623b3d7-b84b-4e18-9f07-03ae3d00770c tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:46.818175 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8623b3d7-b84b-4e18-9f07-03ae3d00770c tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:46.818937 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8623b3d7-b84b-4e18-9f07-03ae3d00770c tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:46.819373 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8623b3d7-b84b-4e18-9f07-03ae3d00770c tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:46.939742 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8623b3d7-b84b-4e18-9f07-03ae3d00770c tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:46.946919 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8623b3d7-b84b-4e18-9f07-03ae3d00770c tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7" status: 200 len: 1265 microversion: 2.1 time: 0.139762 Oct 12 18:35:46.947476 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 618/1246] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:46 2021] GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:35:47.922847 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-38fa74f7-0479-4a6f-a784-8790c344ca9e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:47.922847 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-38fa74f7-0479-4a6f-a784-8790c344ca9e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:47.924011 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-38fa74f7-0479-4a6f-a784-8790c344ca9e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:47.924473 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-38fa74f7-0479-4a6f-a784-8790c344ca9e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:47.925241 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-38fa74f7-0479-4a6f-a784-8790c344ca9e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:47.925667 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-38fa74f7-0479-4a6f-a784-8790c344ca9e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:47.940921 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.wsgi [None req-38fa74f7-0479-4a6f-a784-8790c344ca9e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] HTTP exception thrown: Instance 1ad61db5-995d-47f1-a6d6-891628733252 could not be found. Oct 12 18:35:47.941509 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-38fa74f7-0479-4a6f-a784-8790c344ca9e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Returning 404 to user: Instance 1ad61db5-995d-47f1-a6d6-891628733252 could not be found. {{(pid=109169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:35:47.942332 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-38fa74f7-0479-4a6f-a784-8790c344ca9e tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 404 len: 111 microversion: 2.1 time: 0.029062 Oct 12 18:35:47.943062 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 629/1247] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Oct 12 18:35:47 2021] DELETE /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:35:47.950600 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0a4d533a-a7e4-4a59-8ced-76a89a8e429a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:47.952344 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0a4d533a-a7e4-4a59-8ced-76a89a8e429a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] [instance: 1ad61db5-995d-47f1-a6d6-891628733252] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:47.957115 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0a4d533a-a7e4-4a59-8ced-76a89a8e429a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:47.957562 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0a4d533a-a7e4-4a59-8ced-76a89a8e429a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:47.958359 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0a4d533a-a7e4-4a59-8ced-76a89a8e429a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:47.958786 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0a4d533a-a7e4-4a59-8ced-76a89a8e429a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:47.964076 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-343a719b-50d9-485a-a518-9eb21df76b49 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:47.964977 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-343a719b-50d9-485a-a518-9eb21df76b49 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:47.973143 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-0a4d533a-a7e4-4a59-8ced-76a89a8e429a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] HTTP exception thrown: Instance 1ad61db5-995d-47f1-a6d6-891628733252 could not be found. Oct 12 18:35:47.974008 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0a4d533a-a7e4-4a59-8ced-76a89a8e429a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] Returning 404 to user: Instance 1ad61db5-995d-47f1-a6d6-891628733252 could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:35:47.975660 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0a4d533a-a7e4-4a59-8ced-76a89a8e429a tempest-AttachVolumeTestJSON-695755934 tempest-AttachVolumeTestJSON-695755934-project] 10.222.0.18 "GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252" status: 404 len: 111 microversion: 2.1 time: 0.028665 Oct 12 18:35:47.976445 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 619/1248] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:47 2021] GET /compute/v2.1/servers/1ad61db5-995d-47f1-a6d6-891628733252 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:35:47.978164 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-343a719b-50d9-485a-a518-9eb21df76b49 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:47.978610 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-343a719b-50d9-485a-a518-9eb21df76b49 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:47.979386 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-343a719b-50d9-485a-a518-9eb21df76b49 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:47.980608 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-343a719b-50d9-485a-a518-9eb21df76b49 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:48.116678 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-343a719b-50d9-485a-a518-9eb21df76b49 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:48.124642 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-343a719b-50d9-485a-a518-9eb21df76b49 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7" status: 200 len: 1265 microversion: 2.1 time: 0.163689 Oct 12 18:35:48.124907 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 630/1249] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:47 2021] GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:35:49.144534 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-34234285-dc81-43de-9578-5975ceaee759 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:49.145292 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-34234285-dc81-43de-9578-5975ceaee759 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:49.152826 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-34234285-dc81-43de-9578-5975ceaee759 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:49.153568 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-34234285-dc81-43de-9578-5975ceaee759 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:49.155328 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-34234285-dc81-43de-9578-5975ceaee759 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:49.156043 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-34234285-dc81-43de-9578-5975ceaee759 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:49.306522 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-34234285-dc81-43de-9578-5975ceaee759 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:49.317518 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-34234285-dc81-43de-9578-5975ceaee759 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7" status: 200 len: 1265 microversion: 2.1 time: 0.178737 Oct 12 18:35:49.318696 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 620/1250] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:49 2021] GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:35:50.337023 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-2d26b463-e579-41e0-abff-c3f8f0db95ea tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:50.337576 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-2d26b463-e579-41e0-abff-c3f8f0db95ea tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:50.343948 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2d26b463-e579-41e0-abff-c3f8f0db95ea tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:50.344393 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2d26b463-e579-41e0-abff-c3f8f0db95ea tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:50.345212 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2d26b463-e579-41e0-abff-c3f8f0db95ea tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:50.345643 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2d26b463-e579-41e0-abff-c3f8f0db95ea tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:50.616221 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-2d26b463-e579-41e0-abff-c3f8f0db95ea tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:50.635281 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-2d26b463-e579-41e0-abff-c3f8f0db95ea tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7" status: 200 len: 1265 microversion: 2.1 time: 0.302033 Oct 12 18:35:50.636359 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 631/1251] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:50 2021] GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 => generated 1265 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:35:50.928503 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-6d220bf6-17e9-43b0-9622-30b97f3dbb76 req-70f3b89e-989c-4364-8ef1-3c3e02a9a300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7", "name": "network-vif-plugged", "status": "completed", "tag": "6b64a2da-1847-42d7-b301-103470a2877a"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:35:50.930179 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:35:50.930179 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:35:50.946154 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-6d220bf6-17e9-43b0-9622-30b97f3dbb76 req-70f3b89e-989c-4364-8ef1-3c3e02a9a300 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:50.946682 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-6d220bf6-17e9-43b0-9622-30b97f3dbb76 req-70f3b89e-989c-4364-8ef1-3c3e02a9a300 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:50.968156 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-6d220bf6-17e9-43b0-9622-30b97f3dbb76 req-70f3b89e-989c-4364-8ef1-3c3e02a9a300 service nova] Creating event network-vif-plugged:6b64a2da-1847-42d7-b301-103470a2877a for instance 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 on hv-cinder-81322 Oct 12 18:35:50.973642 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-6d220bf6-17e9-43b0-9622-30b97f3dbb76 req-70f3b89e-989c-4364-8ef1-3c3e02a9a300 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049208 Oct 12 18:35:50.974930 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 621/1252] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:35:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:35:51.657294 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-404d8111-3ddf-48cd-9f80-332e5871d8f7 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:51.658393 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-404d8111-3ddf-48cd-9f80-332e5871d8f7 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:51.667010 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-404d8111-3ddf-48cd-9f80-332e5871d8f7 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:51.667544 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-404d8111-3ddf-48cd-9f80-332e5871d8f7 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:51.668415 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-404d8111-3ddf-48cd-9f80-332e5871d8f7 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:51.668935 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-404d8111-3ddf-48cd-9f80-332e5871d8f7 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:51.883990 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-404d8111-3ddf-48cd-9f80-332e5871d8f7 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:51.891602 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-404d8111-3ddf-48cd-9f80-332e5871d8f7 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7" status: 200 len: 1265 microversion: 2.1 time: 0.240934 Oct 12 18:35:51.892491 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 632/1253] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:51 2021] GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:35:52.909820 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-40148c29-1fd3-4b07-a46d-3814296cdd22 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:52.910588 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-40148c29-1fd3-4b07-a46d-3814296cdd22 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:52.916596 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-40148c29-1fd3-4b07-a46d-3814296cdd22 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:52.917045 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-40148c29-1fd3-4b07-a46d-3814296cdd22 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:52.917808 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-40148c29-1fd3-4b07-a46d-3814296cdd22 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:52.918254 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-40148c29-1fd3-4b07-a46d-3814296cdd22 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:53.059924 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-40148c29-1fd3-4b07-a46d-3814296cdd22 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:53.066933 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-40148c29-1fd3-4b07-a46d-3814296cdd22 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7" status: 200 len: 1265 microversion: 2.1 time: 0.161117 Oct 12 18:35:53.067658 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 622/1254] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:52 2021] GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:35:54.084679 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-202260e2-de7d-4afb-8e8f-f13aaab2dc07 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:54.085381 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-202260e2-de7d-4afb-8e8f-f13aaab2dc07 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:54.091339 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-202260e2-de7d-4afb-8e8f-f13aaab2dc07 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:54.091785 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-202260e2-de7d-4afb-8e8f-f13aaab2dc07 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:54.092654 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-202260e2-de7d-4afb-8e8f-f13aaab2dc07 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:54.093089 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-202260e2-de7d-4afb-8e8f-f13aaab2dc07 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:54.232519 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-202260e2-de7d-4afb-8e8f-f13aaab2dc07 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:54.239975 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-202260e2-de7d-4afb-8e8f-f13aaab2dc07 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7" status: 200 len: 1452 microversion: 2.1 time: 0.158924 Oct 12 18:35:54.240567 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 633/1255] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:54 2021] GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:35:54.256288 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-967ce81c-7408-45b5-829d-50a664d9f781 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:54.256976 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-967ce81c-7408-45b5-829d-50a664d9f781 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:54.262826 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-967ce81c-7408-45b5-829d-50a664d9f781 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:54.263336 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-967ce81c-7408-45b5-829d-50a664d9f781 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:54.264230 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-967ce81c-7408-45b5-829d-50a664d9f781 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:54.264739 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-967ce81c-7408-45b5-829d-50a664d9f781 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:54.427796 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-967ce81c-7408-45b5-829d-50a664d9f781 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:54.435524 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-967ce81c-7408-45b5-829d-50a664d9f781 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7" status: 200 len: 1452 microversion: 2.1 time: 0.182933 Oct 12 18:35:54.436718 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 623/1256] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:54 2021] GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 => generated 1452 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:35:55.832971 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-8a3aa271-425c-4d9d-a3d4-8c9c535f3cf7 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-822721966", "imageRef": "c79f0511-74c5-46f3-a7e6-cde6b09234ee", "flavorRef": "452", "networks": [{"uuid": "61f6d5f9-4048-4750-b2a3-767357f4402f"}]}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:35:55.884862 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.network.neutron [None req-8a3aa271-425c-4d9d-a3d4-8c9c535f3cf7 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] validate_networks() for [('61f6d5f9-4048-4750-b2a3-767357f4402f', None, None, None, None, None)] {{(pid=109169) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 18:35:56.675519 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-8a3aa271-425c-4d9d-a3d4-8c9c535f3cf7 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Flavor limits 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 18:35:56.676046 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-8a3aa271-425c-4d9d-a3d4-8c9c535f3cf7 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Image limits 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 18:35:56.676640 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-8a3aa271-425c-4d9d-a3d4-8c9c535f3cf7 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Flavor pref 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 18:35:56.677115 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-8a3aa271-425c-4d9d-a3d4-8c9c535f3cf7 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Image pref 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 18:35:56.677591 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-8a3aa271-425c-4d9d-a3d4-8c9c535f3cf7 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 18:35:56.691249 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8a3aa271-425c-4d9d-a3d4-8c9c535f3cf7 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:56.692056 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8a3aa271-425c-4d9d-a3d4-8c9c535f3cf7 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:56.693299 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8a3aa271-425c-4d9d-a3d4-8c9c535f3cf7 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:56.694093 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8a3aa271-425c-4d9d-a3d4-8c9c535f3cf7 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:56.712270 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.quota [None req-8a3aa271-425c-4d9d-a3d4-8c9c535f3cf7 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Getting quotas for project 9b114869544b4236a53ce1103cfc7abf. Resources: {'instances', 'cores', 'ram'} {{(pid=109169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:35:56.716459 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.quota [None req-8a3aa271-425c-4d9d-a3d4-8c9c535f3cf7 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Getting quotas for user 75606513d1c04a9a8f95e0c0f60d9c11 and project 9b114869544b4236a53ce1103cfc7abf. Resources: {'instances', 'cores', 'ram'} {{(pid=109169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:35:56.728525 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-8a3aa271-425c-4d9d-a3d4-8c9c535f3cf7 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Going to run 1 instances... {{(pid=109169) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 18:35:56.731013 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-8a3aa271-425c-4d9d-a3d4-8c9c535f3cf7 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: c441c901-c4e6-43f0-8136-f138ee030430] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c79f0511-74c5-46f3-a7e6-cde6b09234ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109169) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 18:35:56.895699 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-8a3aa271-425c-4d9d-a3d4-8c9c535f3cf7 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.176650 Oct 12 18:35:56.897511 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 634/1257] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Oct 12 18:35:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 1178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 18:35:56.907547 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-6be12e1a-06e6-4c71-9287-dba0c07b2544 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:56.908885 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-6be12e1a-06e6-4c71-9287-dba0c07b2544 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: c441c901-c4e6-43f0-8136-f138ee030430] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:56.980142 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-6be12e1a-06e6-4c71-9287-dba0c07b2544 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:56.987092 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-6be12e1a-06e6-4c71-9287-dba0c07b2544 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430" status: 200 len: 1217 microversion: 2.1 time: 0.084058 Oct 12 18:35:56.987711 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 624/1258] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:56 2021] GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430 => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:35:57.245914 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-3529d382-3c54-4d42-801a-1f41a75a957f req-cf1333e7-6f76-4c3b-98ed-67db62ce2930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7", "tag": "6b64a2da-1847-42d7-b301-103470a2877a"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:35:57.247452 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:35:57.247452 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:35:57.257573 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-3529d382-3c54-4d42-801a-1f41a75a957f req-cf1333e7-6f76-4c3b-98ed-67db62ce2930 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:57.258008 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-3529d382-3c54-4d42-801a-1f41a75a957f req-cf1333e7-6f76-4c3b-98ed-67db62ce2930 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:57.269770 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-3529d382-3c54-4d42-801a-1f41a75a957f req-cf1333e7-6f76-4c3b-98ed-67db62ce2930 service nova] Creating event network-changed:6b64a2da-1847-42d7-b301-103470a2877a for instance 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 on hv-cinder-81322 Oct 12 18:35:57.274896 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-3529d382-3c54-4d42-801a-1f41a75a957f req-cf1333e7-6f76-4c3b-98ed-67db62ce2930 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032550 Oct 12 18:35:57.275488 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 635/1259] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:35:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:35:58.007170 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-91458f81-ac06-44ec-b5fc-cf9e11320c9e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:58.007789 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-91458f81-ac06-44ec-b5fc-cf9e11320c9e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: c441c901-c4e6-43f0-8136-f138ee030430] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:58.076720 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-91458f81-ac06-44ec-b5fc-cf9e11320c9e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:58.084728 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-91458f81-ac06-44ec-b5fc-cf9e11320c9e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430" status: 200 len: 1217 microversion: 2.1 time: 0.085015 Oct 12 18:35:58.085857 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 625/1260] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:57 2021] GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:35:59.102994 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-6a03824a-890f-4fdc-8726-878845ee6b45 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:35:59.103766 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-6a03824a-890f-4fdc-8726-878845ee6b45 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: c441c901-c4e6-43f0-8136-f138ee030430] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:35:59.109928 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6a03824a-890f-4fdc-8726-878845ee6b45 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:59.110381 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6a03824a-890f-4fdc-8726-878845ee6b45 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:59.111155 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6a03824a-890f-4fdc-8726-878845ee6b45 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:35:59.111588 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6a03824a-890f-4fdc-8726-878845ee6b45 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:35:59.174065 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-6a03824a-890f-4fdc-8726-878845ee6b45 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:35:59.181501 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-6a03824a-890f-4fdc-8726-878845ee6b45 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430" status: 200 len: 1269 microversion: 2.1 time: 0.082802 Oct 12 18:35:59.188699 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 636/1261] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:35:59 2021] GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430 => generated 1269 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:00.198139 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b617a2c3-2f95-4b7c-95e7-2c5d190e857e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:00.199863 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b617a2c3-2f95-4b7c-95e7-2c5d190e857e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: c441c901-c4e6-43f0-8136-f138ee030430] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:00.206169 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b617a2c3-2f95-4b7c-95e7-2c5d190e857e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:00.206706 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b617a2c3-2f95-4b7c-95e7-2c5d190e857e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:00.207584 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b617a2c3-2f95-4b7c-95e7-2c5d190e857e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:00.208080 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b617a2c3-2f95-4b7c-95e7-2c5d190e857e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:00.278725 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b617a2c3-2f95-4b7c-95e7-2c5d190e857e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:00.286317 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b617a2c3-2f95-4b7c-95e7-2c5d190e857e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430" status: 200 len: 1275 microversion: 2.1 time: 0.091781 Oct 12 18:36:00.286891 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 626/1262] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:00 2021] GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430 => generated 1275 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:01.303981 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-dd8a74cf-4618-43b8-8579-c81cdf1482f2 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:01.304603 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-dd8a74cf-4618-43b8-8579-c81cdf1482f2 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: c441c901-c4e6-43f0-8136-f138ee030430] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:01.310564 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-dd8a74cf-4618-43b8-8579-c81cdf1482f2 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:01.310990 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-dd8a74cf-4618-43b8-8579-c81cdf1482f2 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:01.311755 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-dd8a74cf-4618-43b8-8579-c81cdf1482f2 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:01.312184 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-dd8a74cf-4618-43b8-8579-c81cdf1482f2 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:01.545079 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-dd8a74cf-4618-43b8-8579-c81cdf1482f2 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:01.553008 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-dd8a74cf-4618-43b8-8579-c81cdf1482f2 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430" status: 200 len: 1317 microversion: 2.1 time: 0.253170 Oct 12 18:36:01.553665 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 637/1263] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:01 2021] GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430 => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:01.833370 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-29a286dc-1183-40d0-afe4-32f9c417d878 req-b7cd351b-b21f-498b-a2cf-91a984cece78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c441c901-c4e6-43f0-8136-f138ee030430", "tag": "192f9164-f1d6-4259-8c18-d220be03c0d9"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:36:01.834860 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:36:01.834860 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:36:01.841486 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-29a286dc-1183-40d0-afe4-32f9c417d878 req-b7cd351b-b21f-498b-a2cf-91a984cece78 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:01.841926 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-29a286dc-1183-40d0-afe4-32f9c417d878 req-b7cd351b-b21f-498b-a2cf-91a984cece78 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:01.854415 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-29a286dc-1183-40d0-afe4-32f9c417d878 req-b7cd351b-b21f-498b-a2cf-91a984cece78 service nova] Creating event network-changed:192f9164-f1d6-4259-8c18-d220be03c0d9 for instance c441c901-c4e6-43f0-8136-f138ee030430 on hv-cinder-81322 Oct 12 18:36:01.859370 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-29a286dc-1183-40d0-afe4-32f9c417d878 req-b7cd351b-b21f-498b-a2cf-91a984cece78 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029545 Oct 12 18:36:01.859982 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 627/1264] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:36:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:36:02.570556 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-3a515ac2-a84a-4ab2-9b33-40365f066ce9 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:02.571105 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-3a515ac2-a84a-4ab2-9b33-40365f066ce9 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: c441c901-c4e6-43f0-8136-f138ee030430] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:02.576837 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3a515ac2-a84a-4ab2-9b33-40365f066ce9 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:02.577274 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3a515ac2-a84a-4ab2-9b33-40365f066ce9 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:02.578139 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3a515ac2-a84a-4ab2-9b33-40365f066ce9 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:02.578538 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3a515ac2-a84a-4ab2-9b33-40365f066ce9 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:02.700926 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-3a515ac2-a84a-4ab2-9b33-40365f066ce9 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:02.708691 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-3a515ac2-a84a-4ab2-9b33-40365f066ce9 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430" status: 200 len: 1317 microversion: 2.1 time: 0.141717 Oct 12 18:36:02.709270 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 638/1265] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:02 2021] GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430 => generated 1317 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:03.726287 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e172d8ad-444b-4cdb-8706-446d62157fa5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:03.726971 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e172d8ad-444b-4cdb-8706-446d62157fa5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: c441c901-c4e6-43f0-8136-f138ee030430] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:03.733681 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e172d8ad-444b-4cdb-8706-446d62157fa5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:03.734123 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e172d8ad-444b-4cdb-8706-446d62157fa5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:03.734995 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e172d8ad-444b-4cdb-8706-446d62157fa5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:03.735315 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e172d8ad-444b-4cdb-8706-446d62157fa5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:03.860176 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e172d8ad-444b-4cdb-8706-446d62157fa5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:03.867430 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e172d8ad-444b-4cdb-8706-446d62157fa5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430" status: 200 len: 1317 microversion: 2.1 time: 0.145195 Oct 12 18:36:03.868041 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 628/1266] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:03 2021] GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430 => generated 1317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:04.883709 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-450f9fe0-474a-48eb-85d2-167791162e35 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:04.884245 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-450f9fe0-474a-48eb-85d2-167791162e35 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: c441c901-c4e6-43f0-8136-f138ee030430] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:04.890918 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-450f9fe0-474a-48eb-85d2-167791162e35 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:04.891358 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-450f9fe0-474a-48eb-85d2-167791162e35 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:04.892118 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-450f9fe0-474a-48eb-85d2-167791162e35 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:04.892576 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-450f9fe0-474a-48eb-85d2-167791162e35 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:05.026847 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-450f9fe0-474a-48eb-85d2-167791162e35 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:05.035203 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-450f9fe0-474a-48eb-85d2-167791162e35 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430" status: 200 len: 1317 microversion: 2.1 time: 0.155214 Oct 12 18:36:05.035781 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 639/1267] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:04 2021] GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:06.052112 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a3984158-9ccf-47c0-b828-00e8346dce0f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:06.052721 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a3984158-9ccf-47c0-b828-00e8346dce0f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: c441c901-c4e6-43f0-8136-f138ee030430] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:06.058461 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a3984158-9ccf-47c0-b828-00e8346dce0f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:06.064018 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a3984158-9ccf-47c0-b828-00e8346dce0f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:06.064018 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a3984158-9ccf-47c0-b828-00e8346dce0f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:06.064018 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a3984158-9ccf-47c0-b828-00e8346dce0f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:06.183700 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a3984158-9ccf-47c0-b828-00e8346dce0f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:06.191525 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a3984158-9ccf-47c0-b828-00e8346dce0f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430" status: 200 len: 1317 microversion: 2.1 time: 0.142967 Oct 12 18:36:06.192109 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 629/1268] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:06 2021] GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430 => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:07.211772 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-786b8baf-ea08-445f-9676-34c16d72ff32 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:07.212573 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-786b8baf-ea08-445f-9676-34c16d72ff32 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: c441c901-c4e6-43f0-8136-f138ee030430] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:07.219626 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-786b8baf-ea08-445f-9676-34c16d72ff32 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:07.220133 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-786b8baf-ea08-445f-9676-34c16d72ff32 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:07.220923 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-786b8baf-ea08-445f-9676-34c16d72ff32 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:07.221356 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-786b8baf-ea08-445f-9676-34c16d72ff32 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:07.355641 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-786b8baf-ea08-445f-9676-34c16d72ff32 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:07.363432 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-786b8baf-ea08-445f-9676-34c16d72ff32 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430" status: 200 len: 1317 microversion: 2.1 time: 0.159234 Oct 12 18:36:07.371678 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 640/1269] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:07 2021] GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:08.380616 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7ff80d9f-47e4-462b-9536-0cc9c4f884a4 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:08.381169 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7ff80d9f-47e4-462b-9536-0cc9c4f884a4 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: c441c901-c4e6-43f0-8136-f138ee030430] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:08.387208 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7ff80d9f-47e4-462b-9536-0cc9c4f884a4 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:08.387645 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7ff80d9f-47e4-462b-9536-0cc9c4f884a4 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:08.388432 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7ff80d9f-47e4-462b-9536-0cc9c4f884a4 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:08.388900 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7ff80d9f-47e4-462b-9536-0cc9c4f884a4 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:08.511452 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7ff80d9f-47e4-462b-9536-0cc9c4f884a4 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:08.518597 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7ff80d9f-47e4-462b-9536-0cc9c4f884a4 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430" status: 200 len: 1317 microversion: 2.1 time: 0.141874 Oct 12 18:36:08.519163 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 630/1270] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:08 2021] GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430 => generated 1317 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:08.954244 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-b45b55e8-5f32-44f2-bc9c-27cfe8c1d4d4 req-56695c90-a102-48e2-ade7-4970295cb83d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c441c901-c4e6-43f0-8136-f138ee030430", "name": "network-vif-plugged", "status": "completed", "tag": "192f9164-f1d6-4259-8c18-d220be03c0d9"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:36:08.964360 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:36:08.964360 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:36:08.964360 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-b45b55e8-5f32-44f2-bc9c-27cfe8c1d4d4 req-56695c90-a102-48e2-ade7-4970295cb83d service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:08.964360 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-b45b55e8-5f32-44f2-bc9c-27cfe8c1d4d4 req-56695c90-a102-48e2-ade7-4970295cb83d service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:08.974714 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-b45b55e8-5f32-44f2-bc9c-27cfe8c1d4d4 req-56695c90-a102-48e2-ade7-4970295cb83d service nova] Creating event network-vif-plugged:192f9164-f1d6-4259-8c18-d220be03c0d9 for instance c441c901-c4e6-43f0-8136-f138ee030430 on hv-cinder-81322 Oct 12 18:36:08.980104 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-b45b55e8-5f32-44f2-bc9c-27cfe8c1d4d4 req-56695c90-a102-48e2-ade7-4970295cb83d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030030 Oct 12 18:36:08.980734 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 641/1271] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:36:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:36:09.535083 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3be4d6e1-1d3e-43e5-8adf-3156d546f10d tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:09.535686 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3be4d6e1-1d3e-43e5-8adf-3156d546f10d tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: c441c901-c4e6-43f0-8136-f138ee030430] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:09.541879 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3be4d6e1-1d3e-43e5-8adf-3156d546f10d tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:09.542366 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3be4d6e1-1d3e-43e5-8adf-3156d546f10d tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:09.543196 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3be4d6e1-1d3e-43e5-8adf-3156d546f10d tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:09.543709 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3be4d6e1-1d3e-43e5-8adf-3156d546f10d tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:09.676638 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3be4d6e1-1d3e-43e5-8adf-3156d546f10d tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:09.683869 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3be4d6e1-1d3e-43e5-8adf-3156d546f10d tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430" status: 200 len: 1317 microversion: 2.1 time: 0.152487 Oct 12 18:36:09.684459 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 631/1272] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:09 2021] GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:10.702129 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-f9a33a1f-8bf0-45b8-be5d-e8e5e57b1f00 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:10.712571 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-f9a33a1f-8bf0-45b8-be5d-e8e5e57b1f00 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: c441c901-c4e6-43f0-8136-f138ee030430] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:10.712571 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f9a33a1f-8bf0-45b8-be5d-e8e5e57b1f00 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:10.712571 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f9a33a1f-8bf0-45b8-be5d-e8e5e57b1f00 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:10.712571 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f9a33a1f-8bf0-45b8-be5d-e8e5e57b1f00 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:10.713049 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f9a33a1f-8bf0-45b8-be5d-e8e5e57b1f00 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:10.849155 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-f9a33a1f-8bf0-45b8-be5d-e8e5e57b1f00 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:10.869339 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-f9a33a1f-8bf0-45b8-be5d-e8e5e57b1f00 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430" status: 200 len: 1317 microversion: 2.1 time: 0.171571 Oct 12 18:36:10.869833 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 642/1273] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:10 2021] GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:11.886973 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-188e60d4-0aaa-47a4-8c2e-c2defd71f33c tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:11.887507 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-188e60d4-0aaa-47a4-8c2e-c2defd71f33c tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: c441c901-c4e6-43f0-8136-f138ee030430] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:11.893784 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-188e60d4-0aaa-47a4-8c2e-c2defd71f33c tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:11.898675 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-188e60d4-0aaa-47a4-8c2e-c2defd71f33c tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:11.898675 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-188e60d4-0aaa-47a4-8c2e-c2defd71f33c tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:11.898675 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-188e60d4-0aaa-47a4-8c2e-c2defd71f33c tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:12.012363 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-188e60d4-0aaa-47a4-8c2e-c2defd71f33c tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:12.020138 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-188e60d4-0aaa-47a4-8c2e-c2defd71f33c tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430" status: 200 len: 1506 microversion: 2.1 time: 0.136868 Oct 12 18:36:12.024578 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 632/1274] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:11 2021] GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430 => generated 1506 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:13.828901 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-96a71955-af2d-407e-b218-0319849391bf tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bae0dd9a-29de-45a8-9990-1b4427534822"}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:36:13.829946 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-96a71955-af2d-407e-b218-0319849391bf tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: c441c901-c4e6-43f0-8136-f138ee030430] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:13.835762 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-96a71955-af2d-407e-b218-0319849391bf tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:13.838863 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-96a71955-af2d-407e-b218-0319849391bf tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:13.838863 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-96a71955-af2d-407e-b218-0319849391bf tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:13.838863 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-96a71955-af2d-407e-b218-0319849391bf tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:14.779563 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-96a71955-af2d-407e-b218-0319849391bf tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "POST /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.954854 Oct 12 18:36:14.780592 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 643/1275] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Oct 12 18:36:13 2021] POST /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430/os-volume_attachments => generated 194 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:36:23.389648 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-474142eb-1341-4546-94ad-0a77346965dd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-775102086", "imageRef": "c79f0511-74c5-46f3-a7e6-cde6b09234ee", "flavorRef": "452", "networks": [{"uuid": "61f6d5f9-4048-4750-b2a3-767357f4402f"}]}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:36:23.441392 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.network.neutron [None req-474142eb-1341-4546-94ad-0a77346965dd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] validate_networks() for [('61f6d5f9-4048-4750-b2a3-767357f4402f', None, None, None, None, None)] {{(pid=109168) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 18:36:24.058199 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-474142eb-1341-4546-94ad-0a77346965dd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Flavor limits 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 18:36:24.058623 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-474142eb-1341-4546-94ad-0a77346965dd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Image limits 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 18:36:24.059098 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-474142eb-1341-4546-94ad-0a77346965dd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Flavor pref 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 18:36:24.059505 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-474142eb-1341-4546-94ad-0a77346965dd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Image pref 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 18:36:24.059939 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-474142eb-1341-4546-94ad-0a77346965dd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 18:36:24.068449 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-474142eb-1341-4546-94ad-0a77346965dd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:24.068900 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-474142eb-1341-4546-94ad-0a77346965dd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:24.069700 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-474142eb-1341-4546-94ad-0a77346965dd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:24.070134 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-474142eb-1341-4546-94ad-0a77346965dd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:24.087854 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-474142eb-1341-4546-94ad-0a77346965dd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Getting quotas for project 9b114869544b4236a53ce1103cfc7abf. Resources: {'instances', 'cores', 'ram'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:36:24.091705 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-474142eb-1341-4546-94ad-0a77346965dd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Getting quotas for user 75606513d1c04a9a8f95e0c0f60d9c11 and project 9b114869544b4236a53ce1103cfc7abf. Resources: {'instances', 'cores', 'ram'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:36:24.102579 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-474142eb-1341-4546-94ad-0a77346965dd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Going to run 1 instances... {{(pid=109168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 18:36:24.104897 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-474142eb-1341-4546-94ad-0a77346965dd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 95e86945-e809-401e-9a1a-7c506f4d847f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c79f0511-74c5-46f3-a7e6-cde6b09234ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 18:36:24.231139 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-474142eb-1341-4546-94ad-0a77346965dd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.844974 Oct 12 18:36:24.231693 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 633/1276] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Oct 12 18:36:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 18:36:24.242481 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-6d9233a1-64b1-4315-ae48-e8c21c4e7fb2 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:24.243624 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-6d9233a1-64b1-4315-ae48-e8c21c4e7fb2 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 95e86945-e809-401e-9a1a-7c506f4d847f] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:24.298687 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-6d9233a1-64b1-4315-ae48-e8c21c4e7fb2 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:24.305332 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-6d9233a1-64b1-4315-ae48-e8c21c4e7fb2 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f" status: 200 len: 1217 microversion: 2.1 time: 0.066716 Oct 12 18:36:24.305910 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 644/1277] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:24 2021] GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:25.322295 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b5978214-2c26-49c8-a2aa-db46a928bb44 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:25.322907 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b5978214-2c26-49c8-a2aa-db46a928bb44 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 95e86945-e809-401e-9a1a-7c506f4d847f] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:25.328897 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b5978214-2c26-49c8-a2aa-db46a928bb44 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:25.329347 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b5978214-2c26-49c8-a2aa-db46a928bb44 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:25.330119 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b5978214-2c26-49c8-a2aa-db46a928bb44 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:25.330551 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b5978214-2c26-49c8-a2aa-db46a928bb44 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:25.390703 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b5978214-2c26-49c8-a2aa-db46a928bb44 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:25.397992 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b5978214-2c26-49c8-a2aa-db46a928bb44 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f" status: 200 len: 1221 microversion: 2.1 time: 0.079401 Oct 12 18:36:25.398559 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 634/1278] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:25 2021] GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f => generated 1221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:26.414887 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-bfdffea0-b815-49ac-ae5d-672e179d7571 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:26.415478 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-bfdffea0-b815-49ac-ae5d-672e179d7571 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 95e86945-e809-401e-9a1a-7c506f4d847f] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:26.422787 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bfdffea0-b815-49ac-ae5d-672e179d7571 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:26.423220 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bfdffea0-b815-49ac-ae5d-672e179d7571 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:26.424007 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bfdffea0-b815-49ac-ae5d-672e179d7571 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:26.424499 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-bfdffea0-b815-49ac-ae5d-672e179d7571 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:26.501738 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-bfdffea0-b815-49ac-ae5d-672e179d7571 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:26.509635 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-bfdffea0-b815-49ac-ae5d-672e179d7571 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f" status: 200 len: 1277 microversion: 2.1 time: 0.098369 Oct 12 18:36:26.510219 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 645/1279] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:26 2021] GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f => generated 1277 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:27.534691 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0aec5af5-0410-46ca-845f-18af78550be8 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:27.535307 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0aec5af5-0410-46ca-845f-18af78550be8 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 95e86945-e809-401e-9a1a-7c506f4d847f] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:27.541437 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0aec5af5-0410-46ca-845f-18af78550be8 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:27.541882 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0aec5af5-0410-46ca-845f-18af78550be8 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:27.542655 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0aec5af5-0410-46ca-845f-18af78550be8 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:27.543084 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0aec5af5-0410-46ca-845f-18af78550be8 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:27.782050 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0aec5af5-0410-46ca-845f-18af78550be8 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:27.789245 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0aec5af5-0410-46ca-845f-18af78550be8 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f" status: 200 len: 1317 microversion: 2.1 time: 0.259056 Oct 12 18:36:27.789813 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 635/1280] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:27 2021] GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:28.281358 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-a0607f68-cfa6-4ea3-9e54-415f2da1e6af req-58f5bcdb-0002-4eb7-ac16-c5171508d46d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95e86945-e809-401e-9a1a-7c506f4d847f", "tag": "a254d8df-215f-4c79-ac60-a5b25f3bb041"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:36:28.282938 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:36:28.282938 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:36:28.289984 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-a0607f68-cfa6-4ea3-9e54-415f2da1e6af req-58f5bcdb-0002-4eb7-ac16-c5171508d46d service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:28.290417 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-a0607f68-cfa6-4ea3-9e54-415f2da1e6af req-58f5bcdb-0002-4eb7-ac16-c5171508d46d service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:28.300931 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-a0607f68-cfa6-4ea3-9e54-415f2da1e6af req-58f5bcdb-0002-4eb7-ac16-c5171508d46d service nova] Creating event network-changed:a254d8df-215f-4c79-ac60-a5b25f3bb041 for instance 95e86945-e809-401e-9a1a-7c506f4d847f on hv-cinder-81322 Oct 12 18:36:28.305585 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-a0607f68-cfa6-4ea3-9e54-415f2da1e6af req-58f5bcdb-0002-4eb7-ac16-c5171508d46d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028214 Oct 12 18:36:28.306167 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 646/1281] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:36:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 18:36:28.806122 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9bc0155c-6f52-4dae-b0f7-c003a9ad9610 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:28.806711 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9bc0155c-6f52-4dae-b0f7-c003a9ad9610 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 95e86945-e809-401e-9a1a-7c506f4d847f] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:28.813417 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9bc0155c-6f52-4dae-b0f7-c003a9ad9610 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:28.813876 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9bc0155c-6f52-4dae-b0f7-c003a9ad9610 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:28.814627 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9bc0155c-6f52-4dae-b0f7-c003a9ad9610 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:28.815055 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9bc0155c-6f52-4dae-b0f7-c003a9ad9610 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:29.019293 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9bc0155c-6f52-4dae-b0f7-c003a9ad9610 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:29.028785 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9bc0155c-6f52-4dae-b0f7-c003a9ad9610 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f" status: 200 len: 1317 microversion: 2.1 time: 0.225924 Oct 12 18:36:29.029838 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 636/1282] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:28 2021] GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:30.048780 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c443a35b-bce9-4647-bf3f-1a6d9f6c45c2 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:30.049463 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c443a35b-bce9-4647-bf3f-1a6d9f6c45c2 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 95e86945-e809-401e-9a1a-7c506f4d847f] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:30.055344 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c443a35b-bce9-4647-bf3f-1a6d9f6c45c2 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:30.055778 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c443a35b-bce9-4647-bf3f-1a6d9f6c45c2 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:30.056558 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c443a35b-bce9-4647-bf3f-1a6d9f6c45c2 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:30.056982 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c443a35b-bce9-4647-bf3f-1a6d9f6c45c2 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:30.175216 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c443a35b-bce9-4647-bf3f-1a6d9f6c45c2 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:30.182373 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c443a35b-bce9-4647-bf3f-1a6d9f6c45c2 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f" status: 200 len: 1317 microversion: 2.1 time: 0.137601 Oct 12 18:36:30.182945 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 647/1283] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:30 2021] GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f => generated 1317 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:31.197809 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-163a0eb2-eab1-4878-aae4-c1e4441b2bbd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:31.198411 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-163a0eb2-eab1-4878-aae4-c1e4441b2bbd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 95e86945-e809-401e-9a1a-7c506f4d847f] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:31.204807 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-163a0eb2-eab1-4878-aae4-c1e4441b2bbd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:31.205248 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-163a0eb2-eab1-4878-aae4-c1e4441b2bbd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:31.206000 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-163a0eb2-eab1-4878-aae4-c1e4441b2bbd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:31.206426 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-163a0eb2-eab1-4878-aae4-c1e4441b2bbd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:31.323757 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-163a0eb2-eab1-4878-aae4-c1e4441b2bbd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:31.331519 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-163a0eb2-eab1-4878-aae4-c1e4441b2bbd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f" status: 200 len: 1317 microversion: 2.1 time: 0.137306 Oct 12 18:36:31.332078 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 637/1284] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:31 2021] GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f => generated 1317 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:32.348081 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-b834051f-1dc3-4763-8e11-4800415421b3 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:32.348733 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-b834051f-1dc3-4763-8e11-4800415421b3 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 95e86945-e809-401e-9a1a-7c506f4d847f] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:32.354860 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b834051f-1dc3-4763-8e11-4800415421b3 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:32.355297 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b834051f-1dc3-4763-8e11-4800415421b3 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:32.356047 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b834051f-1dc3-4763-8e11-4800415421b3 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:32.356508 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b834051f-1dc3-4763-8e11-4800415421b3 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:32.485607 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-b834051f-1dc3-4763-8e11-4800415421b3 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:32.492989 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-b834051f-1dc3-4763-8e11-4800415421b3 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f" status: 200 len: 1317 microversion: 2.1 time: 0.148519 Oct 12 18:36:32.493547 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 648/1285] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:32 2021] GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:33.509903 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d7de2475-1de8-4310-b548-c44fa5a8b9fa tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:33.510522 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d7de2475-1de8-4310-b548-c44fa5a8b9fa tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 95e86945-e809-401e-9a1a-7c506f4d847f] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:33.516901 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d7de2475-1de8-4310-b548-c44fa5a8b9fa tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:33.517376 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d7de2475-1de8-4310-b548-c44fa5a8b9fa tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:33.518254 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d7de2475-1de8-4310-b548-c44fa5a8b9fa tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:33.518683 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d7de2475-1de8-4310-b548-c44fa5a8b9fa tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:33.640764 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d7de2475-1de8-4310-b548-c44fa5a8b9fa tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:33.647868 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d7de2475-1de8-4310-b548-c44fa5a8b9fa tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f" status: 200 len: 1317 microversion: 2.1 time: 0.141721 Oct 12 18:36:33.648712 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 638/1286] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:33 2021] GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f => generated 1317 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:36:34.669954 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-2268162b-0afd-4b78-b75c-19f2bb2ac47d tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:34.670485 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-2268162b-0afd-4b78-b75c-19f2bb2ac47d tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 95e86945-e809-401e-9a1a-7c506f4d847f] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:34.676618 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2268162b-0afd-4b78-b75c-19f2bb2ac47d tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:34.677063 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2268162b-0afd-4b78-b75c-19f2bb2ac47d tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:34.677850 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2268162b-0afd-4b78-b75c-19f2bb2ac47d tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:34.678295 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2268162b-0afd-4b78-b75c-19f2bb2ac47d tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:34.802389 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-2268162b-0afd-4b78-b75c-19f2bb2ac47d tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:34.809566 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-2268162b-0afd-4b78-b75c-19f2bb2ac47d tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f" status: 200 len: 1317 microversion: 2.1 time: 0.143307 Oct 12 18:36:34.810143 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 649/1287] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:34 2021] GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f => generated 1317 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:34.999562 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-b1120751-4053-4c1c-87fb-b40c7217db0b req-e1f03af4-e683-4eba-a26b-650f52dc0140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e86945-e809-401e-9a1a-7c506f4d847f", "name": "network-vif-plugged", "status": "completed", "tag": "a254d8df-215f-4c79-ac60-a5b25f3bb041"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:36:35.003093 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:36:35.003093 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:36:35.013976 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-b1120751-4053-4c1c-87fb-b40c7217db0b req-e1f03af4-e683-4eba-a26b-650f52dc0140 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:35.014704 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-b1120751-4053-4c1c-87fb-b40c7217db0b req-e1f03af4-e683-4eba-a26b-650f52dc0140 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:35.027059 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-b1120751-4053-4c1c-87fb-b40c7217db0b req-e1f03af4-e683-4eba-a26b-650f52dc0140 service nova] Creating event network-vif-plugged:a254d8df-215f-4c79-ac60-a5b25f3bb041 for instance 95e86945-e809-401e-9a1a-7c506f4d847f on hv-cinder-81322 Oct 12 18:36:35.032843 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-b1120751-4053-4c1c-87fb-b40c7217db0b req-e1f03af4-e683-4eba-a26b-650f52dc0140 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039778 Oct 12 18:36:35.033505 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 639/1288] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:36:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:36:35.826614 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-21833889-0c32-4efe-8abb-077ecaf64215 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:35.827211 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-21833889-0c32-4efe-8abb-077ecaf64215 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 95e86945-e809-401e-9a1a-7c506f4d847f] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:35.833805 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-21833889-0c32-4efe-8abb-077ecaf64215 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:35.834243 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-21833889-0c32-4efe-8abb-077ecaf64215 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:35.835026 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-21833889-0c32-4efe-8abb-077ecaf64215 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:35.835458 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-21833889-0c32-4efe-8abb-077ecaf64215 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:35.969083 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-21833889-0c32-4efe-8abb-077ecaf64215 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:35.976307 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-21833889-0c32-4efe-8abb-077ecaf64215 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f" status: 200 len: 1317 microversion: 2.1 time: 0.153405 Oct 12 18:36:35.976905 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 650/1289] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:35 2021] GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:36.994690 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4f308ad6-888a-4d62-9d9a-6e021ccfaa00 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:36.995332 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4f308ad6-888a-4d62-9d9a-6e021ccfaa00 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 95e86945-e809-401e-9a1a-7c506f4d847f] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:37.001531 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4f308ad6-888a-4d62-9d9a-6e021ccfaa00 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:37.001977 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4f308ad6-888a-4d62-9d9a-6e021ccfaa00 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:37.002756 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4f308ad6-888a-4d62-9d9a-6e021ccfaa00 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:37.003190 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4f308ad6-888a-4d62-9d9a-6e021ccfaa00 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:37.137614 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4f308ad6-888a-4d62-9d9a-6e021ccfaa00 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:37.145982 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4f308ad6-888a-4d62-9d9a-6e021ccfaa00 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f" status: 200 len: 1317 microversion: 2.1 time: 0.155345 Oct 12 18:36:37.146573 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 640/1290] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:36 2021] GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:38.163069 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-1b0bf4c8-f749-4ef4-b320-89d5a6a2a596 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:38.163670 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-1b0bf4c8-f749-4ef4-b320-89d5a6a2a596 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 95e86945-e809-401e-9a1a-7c506f4d847f] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:38.169743 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1b0bf4c8-f749-4ef4-b320-89d5a6a2a596 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:38.170272 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1b0bf4c8-f749-4ef4-b320-89d5a6a2a596 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:38.175055 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1b0bf4c8-f749-4ef4-b320-89d5a6a2a596 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:38.175055 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1b0bf4c8-f749-4ef4-b320-89d5a6a2a596 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:38.301753 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-1b0bf4c8-f749-4ef4-b320-89d5a6a2a596 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:38.309442 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-1b0bf4c8-f749-4ef4-b320-89d5a6a2a596 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f" status: 200 len: 1507 microversion: 2.1 time: 0.150107 Oct 12 18:36:38.310172 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 651/1291] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:38 2021] GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:38.328849 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-845e1a7f-df10-433d-ad2d-74f964733b1e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bae0dd9a-29de-45a8-9990-1b4427534822"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:36:38.330428 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-845e1a7f-df10-433d-ad2d-74f964733b1e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 95e86945-e809-401e-9a1a-7c506f4d847f] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:38.336672 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-845e1a7f-df10-433d-ad2d-74f964733b1e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:38.337116 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-845e1a7f-df10-433d-ad2d-74f964733b1e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:38.337891 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-845e1a7f-df10-433d-ad2d-74f964733b1e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:38.338320 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-845e1a7f-df10-433d-ad2d-74f964733b1e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:38.419919 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-845e1a7f-df10-433d-ad2d-74f964733b1e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] HTTP exception thrown: Invalid volume: volume bae0dd9a-29de-45a8-9990-1b4427534822 is already attached to instances: c441c901-c4e6-43f0-8136-f138ee030430 Oct 12 18:36:38.420536 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-845e1a7f-df10-433d-ad2d-74f964733b1e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Returning 400 to user: Invalid volume: volume bae0dd9a-29de-45a8-9990-1b4427534822 is already attached to instances: c441c901-c4e6-43f0-8136-f138ee030430 {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:36:38.421365 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-845e1a7f-df10-433d-ad2d-74f964733b1e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "POST /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096892 Oct 12 18:36:38.421916 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 641/1292] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Oct 12 18:36:38 2021] POST /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 18:36:38.482203 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-b5fef8a6-a42b-420f-8921-0bc849054d6f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:38.482699 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-b5fef8a6-a42b-420f-8921-0bc849054d6f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: c441c901-c4e6-43f0-8136-f138ee030430] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:38.494458 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b5fef8a6-a42b-420f-8921-0bc849054d6f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:38.494921 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b5fef8a6-a42b-420f-8921-0bc849054d6f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:38.495716 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b5fef8a6-a42b-420f-8921-0bc849054d6f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:38.496145 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b5fef8a6-a42b-420f-8921-0bc849054d6f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:38.574467 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.objects.instance [None req-b5fef8a6-a42b-420f-8921-0bc849054d6f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lazy-loading 'services' on Instance uuid c441c901-c4e6-43f0-8136-f138ee030430 {{(pid=109169) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:36:38.763417 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-b5fef8a6-a42b-420f-8921-0bc849054d6f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430/os-volume_attachments/bae0dd9a-29de-45a8-9990-1b4427534822" status: 202 len: 0 microversion: 2.1 time: 0.284880 Oct 12 18:36:38.764000 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 652/1293] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Oct 12 18:36:38 2021] DELETE /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430/os-volume_attachments/bae0dd9a-29de-45a8-9990-1b4427534822 => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:36:38.772786 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8b07125b-e4b5-47e7-9ffd-ea8e887d717f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:38.783383 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8b07125b-e4b5-47e7-9ffd-ea8e887d717f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: c441c901-c4e6-43f0-8136-f138ee030430] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:38.783383 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8b07125b-e4b5-47e7-9ffd-ea8e887d717f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:38.783383 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8b07125b-e4b5-47e7-9ffd-ea8e887d717f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:38.783383 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8b07125b-e4b5-47e7-9ffd-ea8e887d717f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:38.783796 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8b07125b-e4b5-47e7-9ffd-ea8e887d717f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:38.817677 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8b07125b-e4b5-47e7-9ffd-ea8e887d717f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041264 Oct 12 18:36:38.817677 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 642/1294] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Oct 12 18:36:38 2021] GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:36:39.823008 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-e388f73e-3b53-4307-a82c-51d1881d4340 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:39.823938 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-e388f73e-3b53-4307-a82c-51d1881d4340 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: c441c901-c4e6-43f0-8136-f138ee030430] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:39.830153 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e388f73e-3b53-4307-a82c-51d1881d4340 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:39.831100 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e388f73e-3b53-4307-a82c-51d1881d4340 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:39.831931 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e388f73e-3b53-4307-a82c-51d1881d4340 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:39.832369 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e388f73e-3b53-4307-a82c-51d1881d4340 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:39.862366 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-e388f73e-3b53-4307-a82c-51d1881d4340 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043520 Oct 12 18:36:39.862927 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 653/1295] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Oct 12 18:36:39 2021] GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:36:40.874125 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3af8583b-f59b-4a6a-b6a5-dae26dd35158 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:40.875625 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3af8583b-f59b-4a6a-b6a5-dae26dd35158 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: c441c901-c4e6-43f0-8136-f138ee030430] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:40.882229 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3af8583b-f59b-4a6a-b6a5-dae26dd35158 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:40.882673 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3af8583b-f59b-4a6a-b6a5-dae26dd35158 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:40.883457 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3af8583b-f59b-4a6a-b6a5-dae26dd35158 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:40.883910 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3af8583b-f59b-4a6a-b6a5-dae26dd35158 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:40.917481 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3af8583b-f59b-4a6a-b6a5-dae26dd35158 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047256 Oct 12 18:36:40.918084 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 643/1296] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Oct 12 18:36:40 2021] GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 18:36:41.019292 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c7922ebe-6b6a-46cd-b1b2-48568ea88516 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1875289838", "imageRef": "c79f0511-74c5-46f3-a7e6-cde6b09234ee", "flavorRef": "452", "networks": [{"uuid": "61f6d5f9-4048-4750-b2a3-767357f4402f"}]}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:36:41.071219 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.network.neutron [None req-c7922ebe-6b6a-46cd-b1b2-48568ea88516 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] validate_networks() for [('61f6d5f9-4048-4750-b2a3-767357f4402f', None, None, None, None, None)] {{(pid=109169) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 18:36:41.431493 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-c7922ebe-6b6a-46cd-b1b2-48568ea88516 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Flavor limits 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 18:36:41.438535 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-c7922ebe-6b6a-46cd-b1b2-48568ea88516 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Image limits 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 18:36:41.438535 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-c7922ebe-6b6a-46cd-b1b2-48568ea88516 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Flavor pref 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 18:36:41.438535 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-c7922ebe-6b6a-46cd-b1b2-48568ea88516 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Image pref 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 18:36:41.438535 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-c7922ebe-6b6a-46cd-b1b2-48568ea88516 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 18:36:41.446646 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c7922ebe-6b6a-46cd-b1b2-48568ea88516 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:41.447086 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c7922ebe-6b6a-46cd-b1b2-48568ea88516 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:41.447874 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c7922ebe-6b6a-46cd-b1b2-48568ea88516 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:41.448303 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c7922ebe-6b6a-46cd-b1b2-48568ea88516 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:41.464460 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.quota [None req-c7922ebe-6b6a-46cd-b1b2-48568ea88516 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Getting quotas for project 9b114869544b4236a53ce1103cfc7abf. Resources: {'instances', 'cores', 'ram'} {{(pid=109169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:36:41.468267 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.quota [None req-c7922ebe-6b6a-46cd-b1b2-48568ea88516 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Getting quotas for user 75606513d1c04a9a8f95e0c0f60d9c11 and project 9b114869544b4236a53ce1103cfc7abf. Resources: {'instances', 'cores', 'ram'} {{(pid=109169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:36:41.478673 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c7922ebe-6b6a-46cd-b1b2-48568ea88516 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Going to run 1 instances... {{(pid=109169) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 18:36:41.481010 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c7922ebe-6b6a-46cd-b1b2-48568ea88516 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: e1d26e71-34c0-4d7a-9d84-e1925fd3656a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c79f0511-74c5-46f3-a7e6-cde6b09234ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109169) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 18:36:41.500921 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-aa3ead59-554d-4fa2-ba8b-32c464b76858 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:41.501855 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-aa3ead59-554d-4fa2-ba8b-32c464b76858 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:41.508277 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-aa3ead59-554d-4fa2-ba8b-32c464b76858 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:41.508754 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-aa3ead59-554d-4fa2-ba8b-32c464b76858 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:41.509524 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-aa3ead59-554d-4fa2-ba8b-32c464b76858 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:41.509957 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-aa3ead59-554d-4fa2-ba8b-32c464b76858 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:41.538740 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-aa3ead59-554d-4fa2-ba8b-32c464b76858 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041577 Oct 12 18:36:41.539285 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 644/1297] 10.222.0.18 () {60 vars in 1342 bytes} [Tue Oct 12 18:36:41 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:36:41.597710 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-20d26792-505c-46fe-98b6-d4a8cdb9f799 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:41.598201 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-20d26792-505c-46fe-98b6-d4a8cdb9f799 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:41.603805 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-20d26792-505c-46fe-98b6-d4a8cdb9f799 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:41.604249 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-20d26792-505c-46fe-98b6-d4a8cdb9f799 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:41.605048 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-20d26792-505c-46fe-98b6-d4a8cdb9f799 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:41.605478 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-20d26792-505c-46fe-98b6-d4a8cdb9f799 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:41.628432 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c7922ebe-6b6a-46cd-b1b2-48568ea88516 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612700 Oct 12 18:36:41.631322 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 654/1298] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Oct 12 18:36:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 18:36:41.631454 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-20d26792-505c-46fe-98b6-d4a8cdb9f799 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Going to try to terminate instance {{(pid=109168) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 18:36:41.639372 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-320c4390-22dc-4673-acd5-21b998611219 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:41.639976 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-320c4390-22dc-4673-acd5-21b998611219 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: e1d26e71-34c0-4d7a-9d84-e1925fd3656a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:41.696251 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-320c4390-22dc-4673-acd5-21b998611219 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:41.703256 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-320c4390-22dc-4673-acd5-21b998611219 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a" status: 200 len: 1218 microversion: 2.1 time: 0.067380 Oct 12 18:36:41.703826 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 655/1299] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:41 2021] GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:36:41.986639 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-20d26792-505c-46fe-98b6-d4a8cdb9f799 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 204 len: 0 microversion: 2.20 time: 0.392647 Oct 12 18:36:41.987165 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 645/1300] 10.222.0.18 () {60 vars in 1279 bytes} [Tue Oct 12 18:36:41 2021] DELETE /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 12 18:36:41.995138 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-651704d7-dbfa-4025-9246-67e1b51fe92e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:41.995790 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-651704d7-dbfa-4025-9246-67e1b51fe92e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:42.002188 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-651704d7-dbfa-4025-9246-67e1b51fe92e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:42.002628 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-651704d7-dbfa-4025-9246-67e1b51fe92e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:42.003389 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-651704d7-dbfa-4025-9246-67e1b51fe92e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:42.003819 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-651704d7-dbfa-4025-9246-67e1b51fe92e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:42.123305 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-651704d7-dbfa-4025-9246-67e1b51fe92e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:42.130917 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-651704d7-dbfa-4025-9246-67e1b51fe92e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:42.132480 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-651704d7-dbfa-4025-9246-67e1b51fe92e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:42.133630 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-651704d7-dbfa-4025-9246-67e1b51fe92e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1723 microversion: 2.20 time: 0.142170 Oct 12 18:36:42.134190 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 656/1301] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:36:41 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1723 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 18:36:42.720649 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4ef5873b-e64d-4f4a-a503-1cb85f67fa9a tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:42.721340 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4ef5873b-e64d-4f4a-a503-1cb85f67fa9a tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: e1d26e71-34c0-4d7a-9d84-e1925fd3656a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:42.727193 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4ef5873b-e64d-4f4a-a503-1cb85f67fa9a tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:42.727629 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4ef5873b-e64d-4f4a-a503-1cb85f67fa9a tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:42.728415 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4ef5873b-e64d-4f4a-a503-1cb85f67fa9a tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:42.728837 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4ef5873b-e64d-4f4a-a503-1cb85f67fa9a tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:42.789134 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4ef5873b-e64d-4f4a-a503-1cb85f67fa9a tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:42.796943 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4ef5873b-e64d-4f4a-a503-1cb85f67fa9a tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a" status: 200 len: 1222 microversion: 2.1 time: 0.080239 Oct 12 18:36:42.797572 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 646/1302] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:42 2021] GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:43.152236 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-d380d390-926e-4864-89f0-f984e65ca31e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:43.152899 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-d380d390-926e-4864-89f0-f984e65ca31e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:43.159627 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d380d390-926e-4864-89f0-f984e65ca31e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:43.161783 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d380d390-926e-4864-89f0-f984e65ca31e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:43.161783 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d380d390-926e-4864-89f0-f984e65ca31e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:43.161783 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d380d390-926e-4864-89f0-f984e65ca31e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:43.289097 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-d380d390-926e-4864-89f0-f984e65ca31e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:43.296780 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-d380d390-926e-4864-89f0-f984e65ca31e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:43.298265 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-d380d390-926e-4864-89f0-f984e65ca31e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:43.299977 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-d380d390-926e-4864-89f0-f984e65ca31e tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1723 microversion: 2.20 time: 0.151511 Oct 12 18:36:43.300562 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 657/1303] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:36:43 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:36:43.814147 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-334623d7-39e8-403d-baf4-e6fcbb7a6da8 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:43.815014 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-334623d7-39e8-403d-baf4-e6fcbb7a6da8 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: e1d26e71-34c0-4d7a-9d84-e1925fd3656a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:43.821267 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-334623d7-39e8-403d-baf4-e6fcbb7a6da8 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:43.828094 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-334623d7-39e8-403d-baf4-e6fcbb7a6da8 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:43.828094 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-334623d7-39e8-403d-baf4-e6fcbb7a6da8 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:43.828094 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-334623d7-39e8-403d-baf4-e6fcbb7a6da8 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:43.893434 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-334623d7-39e8-403d-baf4-e6fcbb7a6da8 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:43.905565 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-334623d7-39e8-403d-baf4-e6fcbb7a6da8 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a" status: 200 len: 1278 microversion: 2.1 time: 0.094365 Oct 12 18:36:43.906597 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 647/1304] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:43 2021] GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a => generated 1278 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:36:44.318208 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-e33145a5-5d23-4d63-a158-5dea7e0fa271 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:44.319594 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-e33145a5-5d23-4d63-a158-5dea7e0fa271 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:44.329487 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e33145a5-5d23-4d63-a158-5dea7e0fa271 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:44.330859 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e33145a5-5d23-4d63-a158-5dea7e0fa271 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:44.331880 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e33145a5-5d23-4d63-a158-5dea7e0fa271 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:44.332596 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e33145a5-5d23-4d63-a158-5dea7e0fa271 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:44.559238 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-e33145a5-5d23-4d63-a158-5dea7e0fa271 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:44.568238 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-e33145a5-5d23-4d63-a158-5dea7e0fa271 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:44.569971 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-e33145a5-5d23-4d63-a158-5dea7e0fa271 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:44.571132 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-e33145a5-5d23-4d63-a158-5dea7e0fa271 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1723 microversion: 2.20 time: 0.256776 Oct 12 18:36:44.571682 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 658/1305] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:36:44 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:36:44.934343 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d2d6649f-1a05-44f0-8c39-2927836abbd0 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:44.934945 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d2d6649f-1a05-44f0-8c39-2927836abbd0 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: e1d26e71-34c0-4d7a-9d84-e1925fd3656a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:44.941778 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d2d6649f-1a05-44f0-8c39-2927836abbd0 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:44.942302 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d2d6649f-1a05-44f0-8c39-2927836abbd0 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:44.943178 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d2d6649f-1a05-44f0-8c39-2927836abbd0 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:44.943672 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d2d6649f-1a05-44f0-8c39-2927836abbd0 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:45.091970 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-73d48d45-22ce-4d0f-94a7-657a9c4cd7b3 req-60e7d980-ebeb-45ff-bb61-c1fd186c3086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a73458df-c845-4c48-9839-58d3acdfd4da", "name": "network-vif-deleted", "tag": "6b4b7683-8980-4bd3-9e9f-66f9276cb054"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:36:45.093553 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:36:45.093553 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:36:45.100302 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-73d48d45-22ce-4d0f-94a7-657a9c4cd7b3 req-60e7d980-ebeb-45ff-bb61-c1fd186c3086 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:45.100855 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-73d48d45-22ce-4d0f-94a7-657a9c4cd7b3 req-60e7d980-ebeb-45ff-bb61-c1fd186c3086 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:45.114916 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-73d48d45-22ce-4d0f-94a7-657a9c4cd7b3 req-60e7d980-ebeb-45ff-bb61-c1fd186c3086 service nova] Creating event network-vif-deleted:6b4b7683-8980-4bd3-9e9f-66f9276cb054 for instance a73458df-c845-4c48-9839-58d3acdfd4da on hv-cinder-81322 Oct 12 18:36:45.120232 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-73d48d45-22ce-4d0f-94a7-657a9c4cd7b3 req-60e7d980-ebeb-45ff-bb61-c1fd186c3086 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031842 Oct 12 18:36:45.120867 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 659/1306] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:36:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 18:36:45.159059 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d2d6649f-1a05-44f0-8c39-2927836abbd0 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:45.167083 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d2d6649f-1a05-44f0-8c39-2927836abbd0 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a" status: 200 len: 1318 microversion: 2.1 time: 0.236389 Oct 12 18:36:45.168038 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 648/1307] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:44 2021] GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:45.590470 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-157baab8-08ab-4c2d-be43-124909ae4668 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:45.591171 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-157baab8-08ab-4c2d-be43-124909ae4668 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:45.597667 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-157baab8-08ab-4c2d-be43-124909ae4668 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:45.598250 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-157baab8-08ab-4c2d-be43-124909ae4668 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:45.599027 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-157baab8-08ab-4c2d-be43-124909ae4668 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:45.599453 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-157baab8-08ab-4c2d-be43-124909ae4668 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:45.641072 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-157baab8-08ab-4c2d-be43-124909ae4668 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:45.641521 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-157baab8-08ab-4c2d-be43-124909ae4668 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:45.641977 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.objects.instance [None req-157baab8-08ab-4c2d-be43-124909ae4668 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lazy-loading 'fault' on Instance uuid a73458df-c845-4c48-9839-58d3acdfd4da {{(pid=109169) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:36:45.697273 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-157baab8-08ab-4c2d-be43-124909ae4668 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:45.707611 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-157baab8-08ab-4c2d-be43-124909ae4668 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:45.709158 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-157baab8-08ab-4c2d-be43-124909ae4668 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74acf90c734149808a501de7754b5943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cdd5201533434888e7691148b9a3a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:45.710407 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-157baab8-08ab-4c2d-be43-124909ae4668 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 200 len: 1371 microversion: 2.20 time: 0.123884 Oct 12 18:36:45.710994 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 660/1308] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:36:45 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 1371 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 18:36:45.936499 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-b6bdd623-ba67-43a7-ac11-4fc39fe455e0 req-840c599a-96f7-456f-88cf-d1c2008c5541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1d26e71-34c0-4d7a-9d84-e1925fd3656a", "tag": "34346751-2457-41e9-a11d-b95b457cafe0"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:36:45.938174 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:36:45.938174 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:36:45.946114 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-b6bdd623-ba67-43a7-ac11-4fc39fe455e0 req-840c599a-96f7-456f-88cf-d1c2008c5541 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:45.946706 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-b6bdd623-ba67-43a7-ac11-4fc39fe455e0 req-840c599a-96f7-456f-88cf-d1c2008c5541 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:45.959324 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-b6bdd623-ba67-43a7-ac11-4fc39fe455e0 req-840c599a-96f7-456f-88cf-d1c2008c5541 service nova] Creating event network-changed:34346751-2457-41e9-a11d-b95b457cafe0 for instance e1d26e71-34c0-4d7a-9d84-e1925fd3656a on hv-cinder-81322 Oct 12 18:36:45.971360 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-b6bdd623-ba67-43a7-ac11-4fc39fe455e0 req-840c599a-96f7-456f-88cf-d1c2008c5541 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038594 Oct 12 18:36:45.971967 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 649/1309] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:36:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:36:46.183933 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-ceb04ccb-f582-4e14-94df-b507f0d7f515 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:46.184598 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-ceb04ccb-f582-4e14-94df-b507f0d7f515 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: e1d26e71-34c0-4d7a-9d84-e1925fd3656a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:46.190301 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ceb04ccb-f582-4e14-94df-b507f0d7f515 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:46.190702 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ceb04ccb-f582-4e14-94df-b507f0d7f515 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:46.191458 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ceb04ccb-f582-4e14-94df-b507f0d7f515 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:46.191885 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ceb04ccb-f582-4e14-94df-b507f0d7f515 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:46.331635 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-ceb04ccb-f582-4e14-94df-b507f0d7f515 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:46.339063 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-ceb04ccb-f582-4e14-94df-b507f0d7f515 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a" status: 200 len: 1318 microversion: 2.1 time: 0.158695 Oct 12 18:36:46.339634 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 661/1310] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:46 2021] GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:46.729274 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b2d86e7b-c23b-4c3b-b602-6e2051dcf872 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:46.729968 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b2d86e7b-c23b-4c3b-b602-6e2051dcf872 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:46.735949 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b2d86e7b-c23b-4c3b-b602-6e2051dcf872 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:46.736937 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b2d86e7b-c23b-4c3b-b602-6e2051dcf872 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:46.738075 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b2d86e7b-c23b-4c3b-b602-6e2051dcf872 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:46.738376 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b2d86e7b-c23b-4c3b-b602-6e2051dcf872 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:46.752617 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-b2d86e7b-c23b-4c3b-b602-6e2051dcf872 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] HTTP exception thrown: Instance a73458df-c845-4c48-9839-58d3acdfd4da could not be found. Oct 12 18:36:46.753408 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b2d86e7b-c23b-4c3b-b602-6e2051dcf872 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Returning 404 to user: Instance a73458df-c845-4c48-9839-58d3acdfd4da could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:36:46.754252 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b2d86e7b-c23b-4c3b-b602-6e2051dcf872 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 404 len: 111 microversion: 2.20 time: 0.029099 Oct 12 18:36:46.754812 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 650/1311] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Oct 12 18:36:46 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 18:36:46.968775 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-69bc03d4-8092-4317-a7c2-1e268d9ecff5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '.version_select at 0x7fe297d95af0>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:47.046998 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-69bc03d4-8092-4317-a7c2-1e268d9ecff5 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2090729962" status: 204 len: 0 microversion: 2.20 time: 0.287372 Oct 12 18:36:47.047580 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 662/1312] 10.222.0.18 () {60 vars in 1261 bytes} [Tue Oct 12 18:36:46 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2090729962 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 12 18:36:47.356152 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5c2da068-0c36-4abb-b90f-e0712d2629c0 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:47.357153 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5c2da068-0c36-4abb-b90f-e0712d2629c0 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: e1d26e71-34c0-4d7a-9d84-e1925fd3656a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:47.363077 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5c2da068-0c36-4abb-b90f-e0712d2629c0 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:47.363519 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5c2da068-0c36-4abb-b90f-e0712d2629c0 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:47.364288 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5c2da068-0c36-4abb-b90f-e0712d2629c0 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:47.364744 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5c2da068-0c36-4abb-b90f-e0712d2629c0 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:47.493569 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5c2da068-0c36-4abb-b90f-e0712d2629c0 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:47.501016 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5c2da068-0c36-4abb-b90f-e0712d2629c0 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a" status: 200 len: 1318 microversion: 2.1 time: 0.148430 Oct 12 18:36:47.501521 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 651/1313] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:47 2021] GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:48.518396 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-ebcb70b1-f09d-4fe6-9595-c8a361dab0e6 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:48.518998 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-ebcb70b1-f09d-4fe6-9595-c8a361dab0e6 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: e1d26e71-34c0-4d7a-9d84-e1925fd3656a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:48.525048 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ebcb70b1-f09d-4fe6-9595-c8a361dab0e6 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:48.525486 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ebcb70b1-f09d-4fe6-9595-c8a361dab0e6 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:48.526247 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ebcb70b1-f09d-4fe6-9595-c8a361dab0e6 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:48.526671 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ebcb70b1-f09d-4fe6-9595-c8a361dab0e6 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:48.650640 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-ebcb70b1-f09d-4fe6-9595-c8a361dab0e6 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:48.658261 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-ebcb70b1-f09d-4fe6-9595-c8a361dab0e6 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a" status: 200 len: 1318 microversion: 2.1 time: 0.144171 Oct 12 18:36:48.658828 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 663/1314] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:48 2021] GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:49.157271 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e490d88a-a82a-4383-a7f1-ce9898383ceb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:49.157823 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e490d88a-a82a-4383-a7f1-ce9898383ceb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:49.160696 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: ERROR oslo.messaging._drivers.impl_rabbit [-] [95de5915-31ff-43be-b304-c8b7292b5453] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 18:36:49.165158 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e490d88a-a82a-4383-a7f1-ce9898383ceb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:49.165598 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e490d88a-a82a-4383-a7f1-ce9898383ceb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:49.166426 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e490d88a-a82a-4383-a7f1-ce9898383ceb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:49.167055 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e490d88a-a82a-4383-a7f1-ce9898383ceb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:49.182509 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-e490d88a-a82a-4383-a7f1-ce9898383ceb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] HTTP exception thrown: Instance a73458df-c845-4c48-9839-58d3acdfd4da could not be found. Oct 12 18:36:49.183095 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e490d88a-a82a-4383-a7f1-ce9898383ceb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Returning 404 to user: Instance a73458df-c845-4c48-9839-58d3acdfd4da could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:36:49.183950 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e490d88a-a82a-4383-a7f1-ce9898383ceb tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 404 len: 111 microversion: 2.1 time: 0.030741 Oct 12 18:36:49.184510 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 652/1315] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Oct 12 18:36:49 2021] DELETE /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:36:49.194479 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-884678c5-8293-48f3-8bd8-534abe446ef9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:49.195340 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-884678c5-8293-48f3-8bd8-534abe446ef9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a73458df-c845-4c48-9839-58d3acdfd4da] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:49.202036 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-884678c5-8293-48f3-8bd8-534abe446ef9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:49.202480 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-884678c5-8293-48f3-8bd8-534abe446ef9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:49.203245 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-884678c5-8293-48f3-8bd8-534abe446ef9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:49.203727 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-884678c5-8293-48f3-8bd8-534abe446ef9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:49.219824 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.wsgi [None req-884678c5-8293-48f3-8bd8-534abe446ef9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] HTTP exception thrown: Instance a73458df-c845-4c48-9839-58d3acdfd4da could not be found. Oct 12 18:36:49.221206 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-884678c5-8293-48f3-8bd8-534abe446ef9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Returning 404 to user: Instance a73458df-c845-4c48-9839-58d3acdfd4da could not be found. {{(pid=109169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:36:49.222069 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-884678c5-8293-48f3-8bd8-534abe446ef9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da" status: 404 len: 111 microversion: 2.1 time: 0.033160 Oct 12 18:36:49.222621 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 664/1316] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:49 2021] GET /compute/v2.1/servers/a73458df-c845-4c48-9839-58d3acdfd4da => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:36:49.675353 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-912b9cdc-7961-45fa-83a1-f6dcaf5b8a25 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:49.675960 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-912b9cdc-7961-45fa-83a1-f6dcaf5b8a25 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: e1d26e71-34c0-4d7a-9d84-e1925fd3656a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:49.681740 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-912b9cdc-7961-45fa-83a1-f6dcaf5b8a25 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:49.682185 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-912b9cdc-7961-45fa-83a1-f6dcaf5b8a25 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:49.682981 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-912b9cdc-7961-45fa-83a1-f6dcaf5b8a25 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:49.683413 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-912b9cdc-7961-45fa-83a1-f6dcaf5b8a25 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:49.806913 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-912b9cdc-7961-45fa-83a1-f6dcaf5b8a25 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:49.814050 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-912b9cdc-7961-45fa-83a1-f6dcaf5b8a25 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a" status: 200 len: 1318 microversion: 2.1 time: 0.143053 Oct 12 18:36:49.814608 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 653/1317] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:49 2021] GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:50.600719 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-329bf345-f9ab-43cb-8d9e-b280f1ed426c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:50.601214 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-329bf345-f9ab-43cb-8d9e-b280f1ed426c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:50.607125 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-329bf345-f9ab-43cb-8d9e-b280f1ed426c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:50.607564 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-329bf345-f9ab-43cb-8d9e-b280f1ed426c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:50.608311 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-329bf345-f9ab-43cb-8d9e-b280f1ed426c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:50.608774 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-329bf345-f9ab-43cb-8d9e-b280f1ed426c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:50.623506 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.wsgi [None req-329bf345-f9ab-43cb-8d9e-b280f1ed426c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] HTTP exception thrown: Instance a13e5623-9ecd-4036-b74a-48cbb84908de could not be found. Oct 12 18:36:50.624086 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-329bf345-f9ab-43cb-8d9e-b280f1ed426c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Returning 404 to user: Instance a13e5623-9ecd-4036-b74a-48cbb84908de could not be found. {{(pid=109169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:36:50.624944 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-329bf345-f9ab-43cb-8d9e-b280f1ed426c tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 404 len: 111 microversion: 2.1 time: 0.027840 Oct 12 18:36:50.625497 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 665/1318] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Oct 12 18:36:50 2021] DELETE /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:36:50.633232 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d196dde4-a3c1-40a5-81aa-3c89cafbace9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:50.633791 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d196dde4-a3c1-40a5-81aa-3c89cafbace9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] [instance: a13e5623-9ecd-4036-b74a-48cbb84908de] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:50.650033 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d196dde4-a3c1-40a5-81aa-3c89cafbace9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:50.650479 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d196dde4-a3c1-40a5-81aa-3c89cafbace9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:50.651249 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d196dde4-a3c1-40a5-81aa-3c89cafbace9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:50.651680 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d196dde4-a3c1-40a5-81aa-3c89cafbace9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:50.666685 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO oslo.messaging._drivers.impl_rabbit [-] [95de5915-31ff-43be-b304-c8b7292b5453] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 43332. Oct 12 18:36:50.668540 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-d196dde4-a3c1-40a5-81aa-3c89cafbace9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] HTTP exception thrown: Instance a13e5623-9ecd-4036-b74a-48cbb84908de could not be found. Oct 12 18:36:50.669129 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d196dde4-a3c1-40a5-81aa-3c89cafbace9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] Returning 404 to user: Instance a13e5623-9ecd-4036-b74a-48cbb84908de could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:36:50.669964 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d196dde4-a3c1-40a5-81aa-3c89cafbace9 tempest-AttachVolumeShelveTestJSON-1518504534 tempest-AttachVolumeShelveTestJSON-1518504534-project] 10.222.0.18 "GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de" status: 404 len: 111 microversion: 2.1 time: 0.040397 Oct 12 18:36:50.670506 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 654/1319] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:50 2021] GET /compute/v2.1/servers/a13e5623-9ecd-4036-b74a-48cbb84908de => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:36:50.836458 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-98565bfd-9eac-4dc4-a30c-1086534bcad6 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:50.836458 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-98565bfd-9eac-4dc4-a30c-1086534bcad6 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: e1d26e71-34c0-4d7a-9d84-e1925fd3656a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:50.836785 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-98565bfd-9eac-4dc4-a30c-1086534bcad6 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:50.837118 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-98565bfd-9eac-4dc4-a30c-1086534bcad6 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:50.837871 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-98565bfd-9eac-4dc4-a30c-1086534bcad6 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:50.838295 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-98565bfd-9eac-4dc4-a30c-1086534bcad6 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:50.972935 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-98565bfd-9eac-4dc4-a30c-1086534bcad6 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:50.980606 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-98565bfd-9eac-4dc4-a30c-1086534bcad6 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a" status: 200 len: 1318 microversion: 2.1 time: 0.153771 Oct 12 18:36:50.990271 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 666/1320] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:50 2021] GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:51.129197 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-916ba65c-d677-4943-9a09-edbf9f3c2ce1 req-9b599223-c608-4e21-a78b-fd5999feb189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1d26e71-34c0-4d7a-9d84-e1925fd3656a", "name": "network-vif-plugged", "status": "completed", "tag": "34346751-2457-41e9-a11d-b95b457cafe0"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:36:51.159816 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:36:51.159816 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:36:51.159816 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-916ba65c-d677-4943-9a09-edbf9f3c2ce1 req-9b599223-c608-4e21-a78b-fd5999feb189 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:51.159816 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-916ba65c-d677-4943-9a09-edbf9f3c2ce1 req-9b599223-c608-4e21-a78b-fd5999feb189 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:51.159816 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-916ba65c-d677-4943-9a09-edbf9f3c2ce1 req-9b599223-c608-4e21-a78b-fd5999feb189 service nova] Creating event network-vif-plugged:34346751-2457-41e9-a11d-b95b457cafe0 for instance e1d26e71-34c0-4d7a-9d84-e1925fd3656a on hv-cinder-81322 Oct 12 18:36:51.159816 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-916ba65c-d677-4943-9a09-edbf9f3c2ce1 req-9b599223-c608-4e21-a78b-fd5999feb189 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033500 Oct 12 18:36:51.160716 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 655/1321] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:36:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 18:36:52.000649 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-598320e4-b9f3-4517-9dca-89316f6af53d tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:52.000649 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-598320e4-b9f3-4517-9dca-89316f6af53d tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: e1d26e71-34c0-4d7a-9d84-e1925fd3656a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:52.005784 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-598320e4-b9f3-4517-9dca-89316f6af53d tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:52.006600 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-598320e4-b9f3-4517-9dca-89316f6af53d tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:52.010043 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-598320e4-b9f3-4517-9dca-89316f6af53d tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:52.010731 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-598320e4-b9f3-4517-9dca-89316f6af53d tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:52.147017 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-598320e4-b9f3-4517-9dca-89316f6af53d tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:52.155054 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-598320e4-b9f3-4517-9dca-89316f6af53d tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a" status: 200 len: 1318 microversion: 2.1 time: 0.160681 Oct 12 18:36:52.156252 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 667/1322] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:51 2021] GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:53.175282 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0710c31f-084b-461e-8d79-6693f3228473 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:53.176013 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0710c31f-084b-461e-8d79-6693f3228473 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: e1d26e71-34c0-4d7a-9d84-e1925fd3656a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:53.182078 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0710c31f-084b-461e-8d79-6693f3228473 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:53.182525 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0710c31f-084b-461e-8d79-6693f3228473 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:53.183294 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0710c31f-084b-461e-8d79-6693f3228473 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:53.183726 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0710c31f-084b-461e-8d79-6693f3228473 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:53.308767 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0710c31f-084b-461e-8d79-6693f3228473 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:53.317024 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0710c31f-084b-461e-8d79-6693f3228473 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a" status: 200 len: 1318 microversion: 2.1 time: 0.146420 Oct 12 18:36:53.317673 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 656/1323] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:53 2021] GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:54.335464 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c008cd20-bd04-4bc8-9692-7a7cbd5faa81 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:54.336027 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c008cd20-bd04-4bc8-9692-7a7cbd5faa81 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: e1d26e71-34c0-4d7a-9d84-e1925fd3656a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:54.343135 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c008cd20-bd04-4bc8-9692-7a7cbd5faa81 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:54.343580 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c008cd20-bd04-4bc8-9692-7a7cbd5faa81 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:54.344356 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c008cd20-bd04-4bc8-9692-7a7cbd5faa81 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:54.344813 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c008cd20-bd04-4bc8-9692-7a7cbd5faa81 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:54.485598 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c008cd20-bd04-4bc8-9692-7a7cbd5faa81 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:36:54.494851 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c008cd20-bd04-4bc8-9692-7a7cbd5faa81 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a" status: 200 len: 1508 microversion: 2.1 time: 0.163064 Oct 12 18:36:54.495715 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 668/1324] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:36:54 2021] GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:36:56.787983 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3d58a2db-7b7b-417a-98f9-c9a61801e7d4 tempest-VolumesGetTestJSON-1080553082 tempest-VolumesGetTestJSON-1080553082-project] Action: 'create', calling method: .version_select at 0x7fe2a5ad1040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1084521250", "metadata": {"Type": "work"}}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:36:57.321038 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-f799095c-7a6d-4aeb-9a4c-7f32de7852eb tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e3fa76e-59e4-471d-8d33-891bb27df184"}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:36:57.322081 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-f799095c-7a6d-4aeb-9a4c-7f32de7852eb tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: e1d26e71-34c0-4d7a-9d84-e1925fd3656a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:36:57.327964 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f799095c-7a6d-4aeb-9a4c-7f32de7852eb tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:57.328342 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f799095c-7a6d-4aeb-9a4c-7f32de7852eb tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:57.329134 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f799095c-7a6d-4aeb-9a4c-7f32de7852eb tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:36:57.329568 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-f799095c-7a6d-4aeb-9a4c-7f32de7852eb tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:36:57.462571 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3d58a2db-7b7b-417a-98f9-c9a61801e7d4 tempest-VolumesGetTestJSON-1080553082 tempest-VolumesGetTestJSON-1080553082-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.825589 Oct 12 18:36:57.463276 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 657/1325] 10.222.0.18 () {60 vars in 1155 bytes} [Tue Oct 12 18:36:56 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 827 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 12 18:36:57.473933 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d6a3cc12-2cee-44e7-a5b5-ab2c5fe32630 tempest-VolumesGetTestJSON-1080553082 tempest-VolumesGetTestJSON-1080553082-project] Calling method '.version_select at 0x7fe297be81f0>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:57.520200 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d6a3cc12-2cee-44e7-a5b5-ab2c5fe32630 tempest-VolumesGetTestJSON-1080553082 tempest-VolumesGetTestJSON-1080553082-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/77bf46c9-65c4-43fe-b46b-56a7535e7f4d" status: 200 len: 353 microversion: 2.1 time: 0.049946 Oct 12 18:36:57.520776 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 658/1326] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Oct 12 18:36:57 2021] GET /compute/v2.1/os-volumes/77bf46c9-65c4-43fe-b46b-56a7535e7f4d => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 18:36:58.162533 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-f799095c-7a6d-4aeb-9a4c-7f32de7852eb tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "POST /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.844806 Oct 12 18:36:58.163147 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 669/1327] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Oct 12 18:36:57 2021] POST /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a/os-volume_attachments => generated 194 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 18:36:58.534948 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f43be760-9672-4da5-b246-a4c31042a4fc tempest-VolumesGetTestJSON-1080553082 tempest-VolumesGetTestJSON-1080553082-project] Calling method '.version_select at 0x7fe297c13160>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:58.580748 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f43be760-9672-4da5-b246-a4c31042a4fc tempest-VolumesGetTestJSON-1080553082 tempest-VolumesGetTestJSON-1080553082-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/77bf46c9-65c4-43fe-b46b-56a7535e7f4d" status: 200 len: 354 microversion: 2.1 time: 0.049374 Oct 12 18:36:58.581322 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 659/1328] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Oct 12 18:36:58 2021] GET /compute/v2.1/os-volumes/77bf46c9-65c4-43fe-b46b-56a7535e7f4d => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:36:58.592596 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-b7009d0e-ce9e-44d7-b2d0-010e224c9613 tempest-VolumesGetTestJSON-1080553082 tempest-VolumesGetTestJSON-1080553082-project] Calling method '.version_select at 0x7fe297c2d550>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:58.640676 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-b7009d0e-ce9e-44d7-b2d0-010e224c9613 tempest-VolumesGetTestJSON-1080553082 tempest-VolumesGetTestJSON-1080553082-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/77bf46c9-65c4-43fe-b46b-56a7535e7f4d" status: 200 len: 354 microversion: 2.1 time: 0.051938 Oct 12 18:36:58.641244 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 670/1329] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Oct 12 18:36:58 2021] GET /compute/v2.1/os-volumes/77bf46c9-65c4-43fe-b46b-56a7535e7f4d => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:36:58.657406 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f8920041-efaf-4ffa-9046-3373cf38c373 tempest-VolumesGetTestJSON-1080553082 tempest-VolumesGetTestJSON-1080553082-project] Calling method '.version_select at 0x7fe297c134c0>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:58.871813 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f8920041-efaf-4ffa-9046-3373cf38c373 tempest-VolumesGetTestJSON-1080553082 tempest-VolumesGetTestJSON-1080553082-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/77bf46c9-65c4-43fe-b46b-56a7535e7f4d" status: 202 len: 0 microversion: 2.1 time: 0.218283 Oct 12 18:36:58.872484 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 660/1330] 10.222.0.18 () {58 vars in 1247 bytes} [Tue Oct 12 18:36:58 2021] DELETE /compute/v2.1/os-volumes/77bf46c9-65c4-43fe-b46b-56a7535e7f4d => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:36:58.880512 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-848df81e-17e4-41c9-88d0-288d53d9f235 tempest-VolumesGetTestJSON-1080553082 tempest-VolumesGetTestJSON-1080553082-project] Calling method '.version_select at 0x7fe297d953a0>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:58.929728 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-848df81e-17e4-41c9-88d0-288d53d9f235 tempest-VolumesGetTestJSON-1080553082 tempest-VolumesGetTestJSON-1080553082-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/77bf46c9-65c4-43fe-b46b-56a7535e7f4d" status: 200 len: 353 microversion: 2.1 time: 0.052758 Oct 12 18:36:58.930182 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 671/1331] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Oct 12 18:36:58 2021] GET /compute/v2.1/os-volumes/77bf46c9-65c4-43fe-b46b-56a7535e7f4d => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:36:59.942026 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1c3af7f7-199f-42b6-888a-4b056a279ada tempest-VolumesGetTestJSON-1080553082 tempest-VolumesGetTestJSON-1080553082-project] Calling method '.version_select at 0x7fe297be8ca0>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:36:59.973025 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-1c3af7f7-199f-42b6-888a-4b056a279ada tempest-VolumesGetTestJSON-1080553082 tempest-VolumesGetTestJSON-1080553082-project] HTTP exception thrown: Volume 77bf46c9-65c4-43fe-b46b-56a7535e7f4d could not be found. Oct 12 18:36:59.973212 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1c3af7f7-199f-42b6-888a-4b056a279ada tempest-VolumesGetTestJSON-1080553082 tempest-VolumesGetTestJSON-1080553082-project] Returning 404 to user: Volume 77bf46c9-65c4-43fe-b46b-56a7535e7f4d could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:36:59.974043 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1c3af7f7-199f-42b6-888a-4b056a279ada tempest-VolumesGetTestJSON-1080553082 tempest-VolumesGetTestJSON-1080553082-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/77bf46c9-65c4-43fe-b46b-56a7535e7f4d" status: 404 len: 109 microversion: 2.1 time: 0.035833 Oct 12 18:36:59.974575 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 661/1332] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Oct 12 18:36:59 2021] GET /compute/v2.1/os-volumes/77bf46c9-65c4-43fe-b46b-56a7535e7f4d => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:37:06.695615 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-544b5962-498d-4d4c-b754-da84e2388211 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e3fa76e-59e4-471d-8d33-891bb27df184"}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:37:06.696830 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-544b5962-498d-4d4c-b754-da84e2388211 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: e1d26e71-34c0-4d7a-9d84-e1925fd3656a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:06.703172 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-544b5962-498d-4d4c-b754-da84e2388211 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:06.703611 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-544b5962-498d-4d4c-b754-da84e2388211 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:06.705876 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-544b5962-498d-4d4c-b754-da84e2388211 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:06.705876 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-544b5962-498d-4d4c-b754-da84e2388211 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:06.779744 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.wsgi [None req-544b5962-498d-4d4c-b754-da84e2388211 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] HTTP exception thrown: Invalid volume: volume 0e3fa76e-59e4-471d-8d33-891bb27df184 is already attached to instances: e1d26e71-34c0-4d7a-9d84-e1925fd3656a Oct 12 18:37:06.780594 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-544b5962-498d-4d4c-b754-da84e2388211 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Returning 400 to user: Invalid volume: volume 0e3fa76e-59e4-471d-8d33-891bb27df184 is already attached to instances: e1d26e71-34c0-4d7a-9d84-e1925fd3656a {{(pid=109169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:37:06.781424 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-544b5962-498d-4d4c-b754-da84e2388211 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "POST /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.090141 Oct 12 18:37:06.781961 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 672/1333] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Oct 12 18:37:06 2021] POST /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a/os-volume_attachments => generated 174 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 18:37:06.840591 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-42b6e91d-46e0-46d5-931e-95680fe7a08f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:06.841125 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-42b6e91d-46e0-46d5-931e-95680fe7a08f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: e1d26e71-34c0-4d7a-9d84-e1925fd3656a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:06.847490 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-42b6e91d-46e0-46d5-931e-95680fe7a08f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:06.847934 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-42b6e91d-46e0-46d5-931e-95680fe7a08f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:06.848734 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-42b6e91d-46e0-46d5-931e-95680fe7a08f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:06.849168 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-42b6e91d-46e0-46d5-931e-95680fe7a08f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:06.927408 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-42b6e91d-46e0-46d5-931e-95680fe7a08f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lazy-loading 'services' on Instance uuid e1d26e71-34c0-4d7a-9d84-e1925fd3656a {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:37:07.168366 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-42b6e91d-46e0-46d5-931e-95680fe7a08f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a/os-volume_attachments/0e3fa76e-59e4-471d-8d33-891bb27df184" status: 202 len: 0 microversion: 2.1 time: 0.331738 Oct 12 18:37:07.169048 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 662/1334] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Oct 12 18:37:06 2021] DELETE /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a/os-volume_attachments/0e3fa76e-59e4-471d-8d33-891bb27df184 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:37:07.177852 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-b6bc23d5-f46d-4221-b3d7-4db4e854794a tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:07.178752 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-b6bc23d5-f46d-4221-b3d7-4db4e854794a tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: e1d26e71-34c0-4d7a-9d84-e1925fd3656a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:07.185936 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b6bc23d5-f46d-4221-b3d7-4db4e854794a tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:07.187056 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b6bc23d5-f46d-4221-b3d7-4db4e854794a tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:07.187296 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b6bc23d5-f46d-4221-b3d7-4db4e854794a tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:07.187727 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b6bc23d5-f46d-4221-b3d7-4db4e854794a tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:07.218217 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-b6bc23d5-f46d-4221-b3d7-4db4e854794a tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044769 Oct 12 18:37:07.219129 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 673/1335] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Oct 12 18:37:07 2021] GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:37:08.229759 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7e70df71-7580-4619-ab5b-c611c3b88318 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:08.230813 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7e70df71-7580-4619-ab5b-c611c3b88318 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: e1d26e71-34c0-4d7a-9d84-e1925fd3656a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:08.236839 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7e70df71-7580-4619-ab5b-c611c3b88318 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:08.237334 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7e70df71-7580-4619-ab5b-c611c3b88318 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:08.238111 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7e70df71-7580-4619-ab5b-c611c3b88318 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:08.238548 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7e70df71-7580-4619-ab5b-c611c3b88318 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:08.271990 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7e70df71-7580-4619-ab5b-c611c3b88318 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046278 Oct 12 18:37:08.272589 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 663/1336] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Oct 12 18:37:08 2021] GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 18:37:08.419057 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-3d328b6d-d3d2-4b55-89d8-f99aafee48e5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1872273032", "imageRef": "c79f0511-74c5-46f3-a7e6-cde6b09234ee", "flavorRef": "452", "networks": [{"uuid": "61f6d5f9-4048-4750-b2a3-767357f4402f"}]}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:37:08.469173 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.network.neutron [None req-3d328b6d-d3d2-4b55-89d8-f99aafee48e5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] validate_networks() for [('61f6d5f9-4048-4750-b2a3-767357f4402f', None, None, None, None, None)] {{(pid=109169) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 18:37:09.208606 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-3d328b6d-d3d2-4b55-89d8-f99aafee48e5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Flavor limits 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 18:37:09.209032 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-3d328b6d-d3d2-4b55-89d8-f99aafee48e5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Image limits 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 18:37:09.209502 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-3d328b6d-d3d2-4b55-89d8-f99aafee48e5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Flavor pref 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 18:37:09.209937 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-3d328b6d-d3d2-4b55-89d8-f99aafee48e5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Image pref 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 18:37:09.210488 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-3d328b6d-d3d2-4b55-89d8-f99aafee48e5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 18:37:09.219620 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3d328b6d-d3d2-4b55-89d8-f99aafee48e5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:09.220061 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3d328b6d-d3d2-4b55-89d8-f99aafee48e5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:09.220916 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3d328b6d-d3d2-4b55-89d8-f99aafee48e5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:09.221340 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3d328b6d-d3d2-4b55-89d8-f99aafee48e5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:09.241923 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.quota [None req-3d328b6d-d3d2-4b55-89d8-f99aafee48e5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Getting quotas for project 9b114869544b4236a53ce1103cfc7abf. Resources: {'instances', 'cores', 'ram'} {{(pid=109169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:37:09.247490 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.quota [None req-3d328b6d-d3d2-4b55-89d8-f99aafee48e5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Getting quotas for user 75606513d1c04a9a8f95e0c0f60d9c11 and project 9b114869544b4236a53ce1103cfc7abf. Resources: {'instances', 'cores', 'ram'} {{(pid=109169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:37:09.259024 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-3d328b6d-d3d2-4b55-89d8-f99aafee48e5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Going to run 1 instances... {{(pid=109169) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 18:37:09.261410 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-3d328b6d-d3d2-4b55-89d8-f99aafee48e5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 668b0134-02b7-4800-8060-04c3fe448f4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c79f0511-74c5-46f3-a7e6-cde6b09234ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109169) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 18:37:09.392899 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-3d328b6d-d3d2-4b55-89d8-f99aafee48e5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.977515 Oct 12 18:37:09.393706 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 674/1337] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Oct 12 18:37:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 18:37:09.403288 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-867f3de7-d02f-415c-9a68-37ac5bac9792 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:09.404010 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-867f3de7-d02f-415c-9a68-37ac5bac9792 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 668b0134-02b7-4800-8060-04c3fe448f4b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:09.457564 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-867f3de7-d02f-415c-9a68-37ac5bac9792 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:37:09.463961 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-867f3de7-d02f-415c-9a68-37ac5bac9792 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b" status: 200 len: 1218 microversion: 2.1 time: 0.064380 Oct 12 18:37:09.464545 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 664/1338] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:37:09 2021] GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:37:10.485713 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-74f71c68-9116-4c6d-ac75-81f6554f6cc4 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:10.486852 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-74f71c68-9116-4c6d-ac75-81f6554f6cc4 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 668b0134-02b7-4800-8060-04c3fe448f4b] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:10.494090 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-74f71c68-9116-4c6d-ac75-81f6554f6cc4 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:10.494532 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-74f71c68-9116-4c6d-ac75-81f6554f6cc4 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:10.496027 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-74f71c68-9116-4c6d-ac75-81f6554f6cc4 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:10.496027 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-74f71c68-9116-4c6d-ac75-81f6554f6cc4 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:10.566374 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-74f71c68-9116-4c6d-ac75-81f6554f6cc4 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:37:10.579003 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-74f71c68-9116-4c6d-ac75-81f6554f6cc4 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b" status: 200 len: 1222 microversion: 2.1 time: 0.097452 Oct 12 18:37:10.579584 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 675/1339] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:37:10 2021] GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b => generated 1222 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:37:11.595129 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9d01c1d9-8ef6-4389-9b67-91ca826487ad tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:11.596197 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9d01c1d9-8ef6-4389-9b67-91ca826487ad tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 668b0134-02b7-4800-8060-04c3fe448f4b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:11.602032 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9d01c1d9-8ef6-4389-9b67-91ca826487ad tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:11.602476 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9d01c1d9-8ef6-4389-9b67-91ca826487ad tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:11.603232 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9d01c1d9-8ef6-4389-9b67-91ca826487ad tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:11.603661 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9d01c1d9-8ef6-4389-9b67-91ca826487ad tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:11.662352 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9d01c1d9-8ef6-4389-9b67-91ca826487ad tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:37:11.669468 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9d01c1d9-8ef6-4389-9b67-91ca826487ad tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b" status: 200 len: 1222 microversion: 2.1 time: 0.078062 Oct 12 18:37:11.670024 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 665/1340] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:37:11 2021] GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b => generated 1222 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:37:12.686446 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-db0840b2-8c0c-4a2e-b96d-270667d1a3c8 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:12.687088 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-db0840b2-8c0c-4a2e-b96d-270667d1a3c8 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 668b0134-02b7-4800-8060-04c3fe448f4b] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:12.692903 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-db0840b2-8c0c-4a2e-b96d-270667d1a3c8 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:12.693352 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-db0840b2-8c0c-4a2e-b96d-270667d1a3c8 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:12.694349 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-db0840b2-8c0c-4a2e-b96d-270667d1a3c8 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:12.694533 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-db0840b2-8c0c-4a2e-b96d-270667d1a3c8 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:12.752917 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-db0840b2-8c0c-4a2e-b96d-270667d1a3c8 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:37:12.760029 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-db0840b2-8c0c-4a2e-b96d-270667d1a3c8 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b" status: 200 len: 1214 microversion: 2.1 time: 0.077308 Oct 12 18:37:12.760620 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 676/1341] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:37:12 2021] GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:37:13.777301 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b446514d-57a1-4930-838d-7d049fd14750 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:13.777950 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b446514d-57a1-4930-838d-7d049fd14750 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 668b0134-02b7-4800-8060-04c3fe448f4b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:13.784620 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b446514d-57a1-4930-838d-7d049fd14750 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:13.785066 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b446514d-57a1-4930-838d-7d049fd14750 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:13.785843 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b446514d-57a1-4930-838d-7d049fd14750 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:13.786266 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b446514d-57a1-4930-838d-7d049fd14750 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:13.861819 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b446514d-57a1-4930-838d-7d049fd14750 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:37:13.868904 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b446514d-57a1-4930-838d-7d049fd14750 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b" status: 200 len: 1278 microversion: 2.1 time: 0.095219 Oct 12 18:37:13.869393 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 666/1342] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:37:13 2021] GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b => generated 1278 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:37:14.885769 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-159c41d6-a5e7-4816-bba8-c9c9091d0011 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:14.886377 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-159c41d6-a5e7-4816-bba8-c9c9091d0011 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 668b0134-02b7-4800-8060-04c3fe448f4b] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:14.895604 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-159c41d6-a5e7-4816-bba8-c9c9091d0011 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:14.895604 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-159c41d6-a5e7-4816-bba8-c9c9091d0011 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:14.895604 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-159c41d6-a5e7-4816-bba8-c9c9091d0011 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:14.895604 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-159c41d6-a5e7-4816-bba8-c9c9091d0011 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:15.185984 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-159c41d6-a5e7-4816-bba8-c9c9091d0011 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:37:15.194469 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-159c41d6-a5e7-4816-bba8-c9c9091d0011 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b" status: 200 len: 1318 microversion: 2.1 time: 0.312168 Oct 12 18:37:15.195169 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 677/1343] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:37:14 2021] GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:37:15.581149 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-4d2dc4b3-9f20-46db-bde7-4af2c1157918 req-8b745fdd-3767-456c-9a92-6b4767f3160e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "668b0134-02b7-4800-8060-04c3fe448f4b", "tag": "9f2bc52d-de2d-49d9-8b68-8a291da7ef79"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:37:15.582680 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:37:15.582680 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:37:15.589828 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-4d2dc4b3-9f20-46db-bde7-4af2c1157918 req-8b745fdd-3767-456c-9a92-6b4767f3160e service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:15.590266 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-4d2dc4b3-9f20-46db-bde7-4af2c1157918 req-8b745fdd-3767-456c-9a92-6b4767f3160e service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:15.619051 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-4d2dc4b3-9f20-46db-bde7-4af2c1157918 req-8b745fdd-3767-456c-9a92-6b4767f3160e service nova] Creating event network-changed:9f2bc52d-de2d-49d9-8b68-8a291da7ef79 for instance 668b0134-02b7-4800-8060-04c3fe448f4b on hv-cinder-81322 Oct 12 18:37:15.619051 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-4d2dc4b3-9f20-46db-bde7-4af2c1157918 req-8b745fdd-3767-456c-9a92-6b4767f3160e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151807 Oct 12 18:37:15.619051 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 667/1344] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:37:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 18:37:16.211357 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-5460685c-6095-468d-8d21-0bbd12c379a3 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:16.211905 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-5460685c-6095-468d-8d21-0bbd12c379a3 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 668b0134-02b7-4800-8060-04c3fe448f4b] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:16.217856 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5460685c-6095-468d-8d21-0bbd12c379a3 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:16.218515 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5460685c-6095-468d-8d21-0bbd12c379a3 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:16.219288 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5460685c-6095-468d-8d21-0bbd12c379a3 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:16.219721 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5460685c-6095-468d-8d21-0bbd12c379a3 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:16.447849 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-5460685c-6095-468d-8d21-0bbd12c379a3 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:37:16.455319 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-5460685c-6095-468d-8d21-0bbd12c379a3 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b" status: 200 len: 1318 microversion: 2.1 time: 0.247697 Oct 12 18:37:16.455894 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 678/1345] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:37:16 2021] GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:37:17.472922 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5ce5b31e-4c76-45c1-929b-35bd83dfd0ac tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:17.473622 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5ce5b31e-4c76-45c1-929b-35bd83dfd0ac tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 668b0134-02b7-4800-8060-04c3fe448f4b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:17.479807 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5ce5b31e-4c76-45c1-929b-35bd83dfd0ac tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:17.480257 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5ce5b31e-4c76-45c1-929b-35bd83dfd0ac tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:17.481058 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5ce5b31e-4c76-45c1-929b-35bd83dfd0ac tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:17.481495 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5ce5b31e-4c76-45c1-929b-35bd83dfd0ac tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:17.607371 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5ce5b31e-4c76-45c1-929b-35bd83dfd0ac tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:37:17.614945 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5ce5b31e-4c76-45c1-929b-35bd83dfd0ac tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b" status: 200 len: 1318 microversion: 2.1 time: 0.146798 Oct 12 18:37:17.615502 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 668/1346] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:37:17 2021] GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:37:18.632863 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-87813af6-3ee1-4f81-ac74-cbfc2e47408b tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:18.633547 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-87813af6-3ee1-4f81-ac74-cbfc2e47408b tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 668b0134-02b7-4800-8060-04c3fe448f4b] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:18.639293 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-87813af6-3ee1-4f81-ac74-cbfc2e47408b tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:18.639836 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-87813af6-3ee1-4f81-ac74-cbfc2e47408b tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:18.640651 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-87813af6-3ee1-4f81-ac74-cbfc2e47408b tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:18.641082 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-87813af6-3ee1-4f81-ac74-cbfc2e47408b tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:18.770932 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-87813af6-3ee1-4f81-ac74-cbfc2e47408b tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:37:18.778266 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-87813af6-3ee1-4f81-ac74-cbfc2e47408b tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b" status: 200 len: 1318 microversion: 2.1 time: 0.151048 Oct 12 18:37:18.778821 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 679/1347] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:37:18 2021] GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:37:19.794898 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b5bf84f9-3a68-4e95-8099-5e6068984729 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:19.795675 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b5bf84f9-3a68-4e95-8099-5e6068984729 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 668b0134-02b7-4800-8060-04c3fe448f4b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:19.802558 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b5bf84f9-3a68-4e95-8099-5e6068984729 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:19.803010 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b5bf84f9-3a68-4e95-8099-5e6068984729 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:19.803795 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b5bf84f9-3a68-4e95-8099-5e6068984729 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:19.804225 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b5bf84f9-3a68-4e95-8099-5e6068984729 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:19.933360 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b5bf84f9-3a68-4e95-8099-5e6068984729 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:37:19.940936 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b5bf84f9-3a68-4e95-8099-5e6068984729 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b" status: 200 len: 1318 microversion: 2.1 time: 0.149664 Oct 12 18:37:19.941543 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 669/1348] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:37:19 2021] GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:37:20.974829 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-1806e5f7-af3f-455e-8c7d-19f19c9d646d tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:20.975389 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-1806e5f7-af3f-455e-8c7d-19f19c9d646d tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 668b0134-02b7-4800-8060-04c3fe448f4b] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:20.981656 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1806e5f7-af3f-455e-8c7d-19f19c9d646d tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:20.985637 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1806e5f7-af3f-455e-8c7d-19f19c9d646d tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:20.985637 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1806e5f7-af3f-455e-8c7d-19f19c9d646d tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:20.985637 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1806e5f7-af3f-455e-8c7d-19f19c9d646d tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:21.108753 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-1806e5f7-af3f-455e-8c7d-19f19c9d646d tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:37:21.115957 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-1806e5f7-af3f-455e-8c7d-19f19c9d646d tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b" status: 200 len: 1318 microversion: 2.1 time: 0.145664 Oct 12 18:37:21.120684 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 680/1349] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:37:20 2021] GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:37:21.349210 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-09193217-bdc1-4d75-8aa2-9e5130375d8e req-ba41d132-5c89-4885-8d6d-dbc4a5253a85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "668b0134-02b7-4800-8060-04c3fe448f4b", "name": "network-vif-plugged", "status": "completed", "tag": "9f2bc52d-de2d-49d9-8b68-8a291da7ef79"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:37:21.350728 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:37:21.350728 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:37:21.357602 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-09193217-bdc1-4d75-8aa2-9e5130375d8e req-ba41d132-5c89-4885-8d6d-dbc4a5253a85 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:21.358039 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-09193217-bdc1-4d75-8aa2-9e5130375d8e req-ba41d132-5c89-4885-8d6d-dbc4a5253a85 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:21.368860 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-09193217-bdc1-4d75-8aa2-9e5130375d8e req-ba41d132-5c89-4885-8d6d-dbc4a5253a85 service nova] Creating event network-vif-plugged:9f2bc52d-de2d-49d9-8b68-8a291da7ef79 for instance 668b0134-02b7-4800-8060-04c3fe448f4b on hv-cinder-81322 Oct 12 18:37:21.374417 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-09193217-bdc1-4d75-8aa2-9e5130375d8e req-ba41d132-5c89-4885-8d6d-dbc4a5253a85 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084140 Oct 12 18:37:21.374992 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 670/1350] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:37:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:37:22.132836 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-6fbf8ab2-63af-4841-b79b-d904ebcfe737 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:22.133393 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-6fbf8ab2-63af-4841-b79b-d904ebcfe737 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 668b0134-02b7-4800-8060-04c3fe448f4b] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:22.139175 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6fbf8ab2-63af-4841-b79b-d904ebcfe737 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:22.139600 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6fbf8ab2-63af-4841-b79b-d904ebcfe737 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:22.140356 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6fbf8ab2-63af-4841-b79b-d904ebcfe737 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:22.140812 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6fbf8ab2-63af-4841-b79b-d904ebcfe737 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:22.263442 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-6fbf8ab2-63af-4841-b79b-d904ebcfe737 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:37:22.271305 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-6fbf8ab2-63af-4841-b79b-d904ebcfe737 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b" status: 200 len: 1318 microversion: 2.1 time: 0.142165 Oct 12 18:37:22.271864 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 681/1351] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:37:22 2021] GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:37:23.290451 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-127ea784-066c-42d0-987e-3945f0bd8a92 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:23.291120 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-127ea784-066c-42d0-987e-3945f0bd8a92 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 668b0134-02b7-4800-8060-04c3fe448f4b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:23.297231 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-127ea784-066c-42d0-987e-3945f0bd8a92 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:23.297613 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-127ea784-066c-42d0-987e-3945f0bd8a92 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:23.298373 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-127ea784-066c-42d0-987e-3945f0bd8a92 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:23.298800 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-127ea784-066c-42d0-987e-3945f0bd8a92 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:23.437007 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-127ea784-066c-42d0-987e-3945f0bd8a92 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:37:23.452568 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-127ea784-066c-42d0-987e-3945f0bd8a92 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b" status: 200 len: 1318 microversion: 2.1 time: 0.165917 Oct 12 18:37:23.453499 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 671/1352] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:37:23 2021] GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:37:24.469067 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-8e3af17b-b558-4ee5-a62d-404899fc511e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:24.469661 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-8e3af17b-b558-4ee5-a62d-404899fc511e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 668b0134-02b7-4800-8060-04c3fe448f4b] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:24.475454 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8e3af17b-b558-4ee5-a62d-404899fc511e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:24.475889 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8e3af17b-b558-4ee5-a62d-404899fc511e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:24.476679 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8e3af17b-b558-4ee5-a62d-404899fc511e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:24.477103 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8e3af17b-b558-4ee5-a62d-404899fc511e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:24.606998 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-8e3af17b-b558-4ee5-a62d-404899fc511e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:37:24.615009 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-8e3af17b-b558-4ee5-a62d-404899fc511e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b" status: 200 len: 1507 microversion: 2.1 time: 0.149482 Oct 12 18:37:24.620374 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 682/1353] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:37:24 2021] GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:37:27.307310 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-27dc81a1-f340-4c3b-888a-ad61508ef3c5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "826e5b58-47b7-46df-9cf4-97ae9f2acb43"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:37:27.308364 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-27dc81a1-f340-4c3b-888a-ad61508ef3c5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 668b0134-02b7-4800-8060-04c3fe448f4b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:27.314188 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-27dc81a1-f340-4c3b-888a-ad61508ef3c5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:27.314631 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-27dc81a1-f340-4c3b-888a-ad61508ef3c5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:27.315431 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-27dc81a1-f340-4c3b-888a-ad61508ef3c5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:27.315858 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-27dc81a1-f340-4c3b-888a-ad61508ef3c5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:28.118433 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-27dc81a1-f340-4c3b-888a-ad61508ef3c5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "POST /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.814345 Oct 12 18:37:28.119003 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 672/1354] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Oct 12 18:37:27 2021] POST /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b/os-volume_attachments => generated 194 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:37:41.976799 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-6afe51c3-8841-44b8-8c5f-25f690f67a61 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:41.977704 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-6afe51c3-8841-44b8-8c5f-25f690f67a61 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 668b0134-02b7-4800-8060-04c3fe448f4b] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:41.983512 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6afe51c3-8841-44b8-8c5f-25f690f67a61 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:41.983957 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6afe51c3-8841-44b8-8c5f-25f690f67a61 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:41.984821 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6afe51c3-8841-44b8-8c5f-25f690f67a61 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:41.985254 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-6afe51c3-8841-44b8-8c5f-25f690f67a61 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:42.060742 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.objects.instance [None req-6afe51c3-8841-44b8-8c5f-25f690f67a61 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lazy-loading 'services' on Instance uuid 668b0134-02b7-4800-8060-04c3fe448f4b {{(pid=109169) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:37:42.266440 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-6afe51c3-8841-44b8-8c5f-25f690f67a61 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "DELETE /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b/os-volume_attachments/826e5b58-47b7-46df-9cf4-97ae9f2acb43" status: 202 len: 0 microversion: 2.1 time: 0.293260 Oct 12 18:37:42.267028 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 683/1355] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Oct 12 18:37:41 2021] DELETE /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b/os-volume_attachments/826e5b58-47b7-46df-9cf4-97ae9f2acb43 => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:37:42.276084 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e23f130e-b8b5-48ed-9eec-9f0b15ab507b tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:42.277198 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e23f130e-b8b5-48ed-9eec-9f0b15ab507b tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 668b0134-02b7-4800-8060-04c3fe448f4b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:42.285568 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e23f130e-b8b5-48ed-9eec-9f0b15ab507b tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:42.286007 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e23f130e-b8b5-48ed-9eec-9f0b15ab507b tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:42.286759 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e23f130e-b8b5-48ed-9eec-9f0b15ab507b tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:42.287184 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e23f130e-b8b5-48ed-9eec-9f0b15ab507b tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:42.314477 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e23f130e-b8b5-48ed-9eec-9f0b15ab507b tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042320 Oct 12 18:37:42.315476 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 673/1356] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Oct 12 18:37:42 2021] GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:37:43.326939 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c551ba97-b8cf-4aab-b711-a093d0200415 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:43.327976 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c551ba97-b8cf-4aab-b711-a093d0200415 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 668b0134-02b7-4800-8060-04c3fe448f4b] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:43.334725 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c551ba97-b8cf-4aab-b711-a093d0200415 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:43.335163 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c551ba97-b8cf-4aab-b711-a093d0200415 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:43.335913 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c551ba97-b8cf-4aab-b711-a093d0200415 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:43.336334 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c551ba97-b8cf-4aab-b711-a093d0200415 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:43.364336 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c551ba97-b8cf-4aab-b711-a093d0200415 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041550 Oct 12 18:37:43.364896 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 684/1357] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Oct 12 18:37:43 2021] GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:37:44.375664 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d675282f-c78d-42e2-8d77-35de6510da06 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:44.376594 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d675282f-c78d-42e2-8d77-35de6510da06 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 668b0134-02b7-4800-8060-04c3fe448f4b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:44.383336 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d675282f-c78d-42e2-8d77-35de6510da06 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:44.383780 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d675282f-c78d-42e2-8d77-35de6510da06 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:44.384577 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d675282f-c78d-42e2-8d77-35de6510da06 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:44.385005 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d675282f-c78d-42e2-8d77-35de6510da06 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:44.413359 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d675282f-c78d-42e2-8d77-35de6510da06 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041329 Oct 12 18:37:44.414112 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 674/1358] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Oct 12 18:37:44 2021] GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:37:45.424490 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-77212bf6-5f7d-4be7-be7c-e83b0289ebda tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:45.425415 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-77212bf6-5f7d-4be7-be7c-e83b0289ebda tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 668b0134-02b7-4800-8060-04c3fe448f4b] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:45.431121 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-77212bf6-5f7d-4be7-be7c-e83b0289ebda tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:45.431549 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-77212bf6-5f7d-4be7-be7c-e83b0289ebda tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:45.432347 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-77212bf6-5f7d-4be7-be7c-e83b0289ebda tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:45.432782 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-77212bf6-5f7d-4be7-be7c-e83b0289ebda tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:45.461137 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-77212bf6-5f7d-4be7-be7c-e83b0289ebda tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040323 Oct 12 18:37:45.461612 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 685/1359] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Oct 12 18:37:45 2021] GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 18:37:46.804675 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-18678f94-176f-4c08-b53e-49dd27507b98 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:46.805168 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-18678f94-176f-4c08-b53e-49dd27507b98 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 668b0134-02b7-4800-8060-04c3fe448f4b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:46.810777 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-18678f94-176f-4c08-b53e-49dd27507b98 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:46.811213 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-18678f94-176f-4c08-b53e-49dd27507b98 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:46.811962 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-18678f94-176f-4c08-b53e-49dd27507b98 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:46.812387 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-18678f94-176f-4c08-b53e-49dd27507b98 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:46.836719 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-18678f94-176f-4c08-b53e-49dd27507b98 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 668b0134-02b7-4800-8060-04c3fe448f4b] Going to try to terminate instance {{(pid=109168) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 18:37:47.164298 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-18678f94-176f-4c08-b53e-49dd27507b98 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "DELETE /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b" status: 204 len: 0 microversion: 2.1 time: 0.362874 Oct 12 18:37:47.164962 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 675/1360] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Oct 12 18:37:46 2021] DELETE /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 18:37:47.172539 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-4433ed4d-92ad-4685-8346-0ac3440112d5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:47.173152 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-4433ed4d-92ad-4685-8346-0ac3440112d5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 668b0134-02b7-4800-8060-04c3fe448f4b] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:47.179400 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4433ed4d-92ad-4685-8346-0ac3440112d5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:47.179840 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4433ed4d-92ad-4685-8346-0ac3440112d5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:47.180632 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4433ed4d-92ad-4685-8346-0ac3440112d5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:47.181063 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4433ed4d-92ad-4685-8346-0ac3440112d5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:47.302118 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-4433ed4d-92ad-4685-8346-0ac3440112d5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:37:47.309885 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-4433ed4d-92ad-4685-8346-0ac3440112d5 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b" status: 200 len: 1513 microversion: 2.1 time: 0.140913 Oct 12 18:37:47.310448 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 686/1361] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:37:47 2021] GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b => generated 1513 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:37:48.327245 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-62dcab89-c121-444c-979b-4a82017458ed tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:48.327976 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-62dcab89-c121-444c-979b-4a82017458ed tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 668b0134-02b7-4800-8060-04c3fe448f4b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:48.334530 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-62dcab89-c121-444c-979b-4a82017458ed tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:48.334975 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-62dcab89-c121-444c-979b-4a82017458ed tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:48.335743 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-62dcab89-c121-444c-979b-4a82017458ed tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:48.336175 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-62dcab89-c121-444c-979b-4a82017458ed tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:48.466039 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-62dcab89-c121-444c-979b-4a82017458ed tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:37:48.471897 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-62dcab89-c121-444c-979b-4a82017458ed tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b" status: 200 len: 1513 microversion: 2.1 time: 0.148603 Oct 12 18:37:48.476963 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 676/1362] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:37:48 2021] GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:37:49.489260 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-acdeb142-eb21-48b6-b5b5-b197ac8e2a67 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:49.489804 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-acdeb142-eb21-48b6-b5b5-b197ac8e2a67 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 668b0134-02b7-4800-8060-04c3fe448f4b] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:49.496188 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-acdeb142-eb21-48b6-b5b5-b197ac8e2a67 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:49.496626 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-acdeb142-eb21-48b6-b5b5-b197ac8e2a67 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:49.502018 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-acdeb142-eb21-48b6-b5b5-b197ac8e2a67 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:49.502018 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-acdeb142-eb21-48b6-b5b5-b197ac8e2a67 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:49.622252 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-acdeb142-eb21-48b6-b5b5-b197ac8e2a67 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:37:49.629684 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-acdeb142-eb21-48b6-b5b5-b197ac8e2a67 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b" status: 200 len: 1513 microversion: 2.1 time: 0.144051 Oct 12 18:37:49.630985 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 687/1363] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:37:49 2021] GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b => generated 1513 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:37:50.241158 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-b41881aa-d6ed-4d78-81cc-fd41c47ee6bb req-de668c96-77e9-4022-a07d-db9d709967e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "668b0134-02b7-4800-8060-04c3fe448f4b", "name": "network-vif-deleted", "tag": "9f2bc52d-de2d-49d9-8b68-8a291da7ef79"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:37:50.243334 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:37:50.243334 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:37:50.250137 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-b41881aa-d6ed-4d78-81cc-fd41c47ee6bb req-de668c96-77e9-4022-a07d-db9d709967e2 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:50.250596 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-b41881aa-d6ed-4d78-81cc-fd41c47ee6bb req-de668c96-77e9-4022-a07d-db9d709967e2 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:50.262030 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-b41881aa-d6ed-4d78-81cc-fd41c47ee6bb req-de668c96-77e9-4022-a07d-db9d709967e2 service nova] Creating event network-vif-deleted:9f2bc52d-de2d-49d9-8b68-8a291da7ef79 for instance 668b0134-02b7-4800-8060-04c3fe448f4b on hv-cinder-81322 Oct 12 18:37:50.266977 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-b41881aa-d6ed-4d78-81cc-fd41c47ee6bb req-de668c96-77e9-4022-a07d-db9d709967e2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029419 Oct 12 18:37:50.267558 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 677/1364] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:37:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 18:37:50.646654 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c1af49c8-c321-453c-ad77-abae0ea87d3e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:50.647152 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c1af49c8-c321-453c-ad77-abae0ea87d3e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 668b0134-02b7-4800-8060-04c3fe448f4b] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:50.652757 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c1af49c8-c321-453c-ad77-abae0ea87d3e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:50.653195 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c1af49c8-c321-453c-ad77-abae0ea87d3e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:50.653945 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c1af49c8-c321-453c-ad77-abae0ea87d3e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:50.654372 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c1af49c8-c321-453c-ad77-abae0ea87d3e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:50.683899 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c1af49c8-c321-453c-ad77-abae0ea87d3e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:50.684336 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c1af49c8-c321-453c-ad77-abae0ea87d3e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:50.684811 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.objects.instance [None req-c1af49c8-c321-453c-ad77-abae0ea87d3e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lazy-loading 'fault' on Instance uuid 668b0134-02b7-4800-8060-04c3fe448f4b {{(pid=109169) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:37:50.724112 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c1af49c8-c321-453c-ad77-abae0ea87d3e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:37:50.731809 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c1af49c8-c321-453c-ad77-abae0ea87d3e tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b" status: 200 len: 1308 microversion: 2.1 time: 0.089388 Oct 12 18:37:50.732370 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 688/1365] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:37:50 2021] GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b => generated 1308 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:37:51.749574 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7d26524e-1e4d-437d-a07c-8b3912a64a18 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:51.750299 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7d26524e-1e4d-437d-a07c-8b3912a64a18 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 668b0134-02b7-4800-8060-04c3fe448f4b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:51.756691 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7d26524e-1e4d-437d-a07c-8b3912a64a18 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:51.757136 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7d26524e-1e4d-437d-a07c-8b3912a64a18 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:51.757896 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7d26524e-1e4d-437d-a07c-8b3912a64a18 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:51.758325 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7d26524e-1e4d-437d-a07c-8b3912a64a18 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:51.770821 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-7d26524e-1e4d-437d-a07c-8b3912a64a18 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] HTTP exception thrown: Instance 668b0134-02b7-4800-8060-04c3fe448f4b could not be found. Oct 12 18:37:51.772088 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7d26524e-1e4d-437d-a07c-8b3912a64a18 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Returning 404 to user: Instance 668b0134-02b7-4800-8060-04c3fe448f4b could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:37:51.773057 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7d26524e-1e4d-437d-a07c-8b3912a64a18 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b" status: 404 len: 111 microversion: 2.1 time: 0.027571 Oct 12 18:37:51.773578 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 678/1366] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:37:51 2021] GET /compute/v2.1/servers/668b0134-02b7-4800-8060-04c3fe448f4b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:37:53.065906 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-29813e24-9879-428d-853c-50a866e810fb tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:53.066426 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-29813e24-9879-428d-853c-50a866e810fb tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: e1d26e71-34c0-4d7a-9d84-e1925fd3656a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:53.072835 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-29813e24-9879-428d-853c-50a866e810fb tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:53.073278 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-29813e24-9879-428d-853c-50a866e810fb tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:53.074043 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-29813e24-9879-428d-853c-50a866e810fb tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:53.074468 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-29813e24-9879-428d-853c-50a866e810fb tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:53.098409 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-29813e24-9879-428d-853c-50a866e810fb tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: e1d26e71-34c0-4d7a-9d84-e1925fd3656a] Going to try to terminate instance {{(pid=109169) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 18:37:53.399215 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-29813e24-9879-428d-853c-50a866e810fb tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a" status: 204 len: 0 microversion: 2.1 time: 0.338012 Oct 12 18:37:53.400103 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 689/1367] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Oct 12 18:37:53 2021] DELETE /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 18:37:53.408054 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-eae1aa4c-dda7-4064-aa4f-6d387c314b48 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:53.408685 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-eae1aa4c-dda7-4064-aa4f-6d387c314b48 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: e1d26e71-34c0-4d7a-9d84-e1925fd3656a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:53.414770 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eae1aa4c-dda7-4064-aa4f-6d387c314b48 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:53.415227 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eae1aa4c-dda7-4064-aa4f-6d387c314b48 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:53.416007 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eae1aa4c-dda7-4064-aa4f-6d387c314b48 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:53.416468 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eae1aa4c-dda7-4064-aa4f-6d387c314b48 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:53.581190 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-eae1aa4c-dda7-4064-aa4f-6d387c314b48 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:37:53.589476 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-eae1aa4c-dda7-4064-aa4f-6d387c314b48 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a" status: 200 len: 1514 microversion: 2.1 time: 0.185301 Oct 12 18:37:53.597489 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 679/1368] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:37:53 2021] GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a => generated 1514 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:37:54.606522 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-0347b186-d41b-4415-ac69-99936d750396 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:54.607207 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-0347b186-d41b-4415-ac69-99936d750396 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: e1d26e71-34c0-4d7a-9d84-e1925fd3656a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:54.612895 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0347b186-d41b-4415-ac69-99936d750396 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:54.613333 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0347b186-d41b-4415-ac69-99936d750396 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:54.614085 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0347b186-d41b-4415-ac69-99936d750396 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:54.614507 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0347b186-d41b-4415-ac69-99936d750396 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:54.735230 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-0347b186-d41b-4415-ac69-99936d750396 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:37:54.742333 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-0347b186-d41b-4415-ac69-99936d750396 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a" status: 200 len: 1514 microversion: 2.1 time: 0.139781 Oct 12 18:37:54.742891 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 690/1369] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:37:54 2021] GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a => generated 1514 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:37:55.758802 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-fc2c8c7a-e405-4f1f-9862-8d4b1d735bd3 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:55.759406 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-fc2c8c7a-e405-4f1f-9862-8d4b1d735bd3 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: e1d26e71-34c0-4d7a-9d84-e1925fd3656a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:55.765383 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fc2c8c7a-e405-4f1f-9862-8d4b1d735bd3 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:55.765821 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fc2c8c7a-e405-4f1f-9862-8d4b1d735bd3 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:55.766577 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fc2c8c7a-e405-4f1f-9862-8d4b1d735bd3 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:55.767005 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fc2c8c7a-e405-4f1f-9862-8d4b1d735bd3 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:55.886603 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-fc2c8c7a-e405-4f1f-9862-8d4b1d735bd3 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:37:55.893814 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-fc2c8c7a-e405-4f1f-9862-8d4b1d735bd3 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a" status: 200 len: 1514 microversion: 2.1 time: 0.138672 Oct 12 18:37:55.902889 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 680/1370] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:37:55 2021] GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a => generated 1514 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:37:56.911352 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c0a3a93c-92eb-4784-9847-43e91d129dea tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:56.911881 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c0a3a93c-92eb-4784-9847-43e91d129dea tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: e1d26e71-34c0-4d7a-9d84-e1925fd3656a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:56.918369 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c0a3a93c-92eb-4784-9847-43e91d129dea tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:56.918810 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c0a3a93c-92eb-4784-9847-43e91d129dea tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:56.919559 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c0a3a93c-92eb-4784-9847-43e91d129dea tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:56.919990 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c0a3a93c-92eb-4784-9847-43e91d129dea tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:57.038653 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c0a3a93c-92eb-4784-9847-43e91d129dea tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:37:57.046236 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c0a3a93c-92eb-4784-9847-43e91d129dea tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a" status: 200 len: 1514 microversion: 2.1 time: 0.138608 Oct 12 18:37:57.046822 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 691/1371] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:37:56 2021] GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a => generated 1514 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:37:58.063350 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-75e63c47-929c-43cf-b3b0-5ab4dab117e8 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:58.063946 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-75e63c47-929c-43cf-b3b0-5ab4dab117e8 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: e1d26e71-34c0-4d7a-9d84-e1925fd3656a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:58.070058 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-75e63c47-929c-43cf-b3b0-5ab4dab117e8 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:58.070496 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-75e63c47-929c-43cf-b3b0-5ab4dab117e8 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:58.071276 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-75e63c47-929c-43cf-b3b0-5ab4dab117e8 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:58.071700 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-75e63c47-929c-43cf-b3b0-5ab4dab117e8 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:58.189923 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-75e63c47-929c-43cf-b3b0-5ab4dab117e8 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:37:58.197545 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-75e63c47-929c-43cf-b3b0-5ab4dab117e8 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a" status: 200 len: 1514 microversion: 2.1 time: 0.137798 Oct 12 18:37:58.198094 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 681/1372] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:37:58 2021] GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a => generated 1514 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:37:59.213872 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-da50f608-c9b2-4ae8-b2a2-eccf61d394af tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:37:59.214479 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-da50f608-c9b2-4ae8-b2a2-eccf61d394af tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: e1d26e71-34c0-4d7a-9d84-e1925fd3656a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:37:59.220180 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-da50f608-c9b2-4ae8-b2a2-eccf61d394af tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:59.220666 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-da50f608-c9b2-4ae8-b2a2-eccf61d394af tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:59.221420 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-da50f608-c9b2-4ae8-b2a2-eccf61d394af tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:37:59.221844 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-da50f608-c9b2-4ae8-b2a2-eccf61d394af tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:37:59.342079 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-da50f608-c9b2-4ae8-b2a2-eccf61d394af tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:37:59.349213 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-da50f608-c9b2-4ae8-b2a2-eccf61d394af tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a" status: 200 len: 1514 microversion: 2.1 time: 0.138913 Oct 12 18:37:59.349775 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 692/1373] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:37:59 2021] GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a => generated 1514 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:38:00.366294 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-167877f2-c9f4-4ed1-b831-c3852b523969 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:38:00.366904 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-167877f2-c9f4-4ed1-b831-c3852b523969 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: e1d26e71-34c0-4d7a-9d84-e1925fd3656a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:38:00.373289 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-167877f2-c9f4-4ed1-b831-c3852b523969 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:00.373730 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-167877f2-c9f4-4ed1-b831-c3852b523969 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:00.374488 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-167877f2-c9f4-4ed1-b831-c3852b523969 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:00.374920 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-167877f2-c9f4-4ed1-b831-c3852b523969 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:00.516164 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-167877f2-c9f4-4ed1-b831-c3852b523969 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:38:00.523314 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-167877f2-c9f4-4ed1-b831-c3852b523969 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a" status: 200 len: 1514 microversion: 2.1 time: 0.160615 Oct 12 18:38:00.523876 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 682/1374] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:38:00 2021] GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:38:01.006083 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-b9100d23-a9be-449d-986a-35a185389295 req-1149dbb9-9b13-41ef-8666-e880a09907ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1d26e71-34c0-4d7a-9d84-e1925fd3656a", "name": "network-vif-deleted", "tag": "34346751-2457-41e9-a11d-b95b457cafe0"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:38:01.007593 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:38:01.007593 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:38:01.014880 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-b9100d23-a9be-449d-986a-35a185389295 req-1149dbb9-9b13-41ef-8666-e880a09907ae service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:01.015317 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-b9100d23-a9be-449d-986a-35a185389295 req-1149dbb9-9b13-41ef-8666-e880a09907ae service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:01.025886 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-b9100d23-a9be-449d-986a-35a185389295 req-1149dbb9-9b13-41ef-8666-e880a09907ae service nova] Creating event network-vif-deleted:34346751-2457-41e9-a11d-b95b457cafe0 for instance e1d26e71-34c0-4d7a-9d84-e1925fd3656a on hv-cinder-81322 Oct 12 18:38:01.031057 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-b9100d23-a9be-449d-986a-35a185389295 req-1149dbb9-9b13-41ef-8666-e880a09907ae service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028291 Oct 12 18:38:01.031625 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 693/1375] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:38:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:38:01.541618 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e0a24182-7f0e-4501-b3c3-31587c3a5092 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:38:01.542248 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e0a24182-7f0e-4501-b3c3-31587c3a5092 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: e1d26e71-34c0-4d7a-9d84-e1925fd3656a] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:38:01.548811 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e0a24182-7f0e-4501-b3c3-31587c3a5092 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:01.549250 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e0a24182-7f0e-4501-b3c3-31587c3a5092 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:01.550065 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e0a24182-7f0e-4501-b3c3-31587c3a5092 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:01.550576 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e0a24182-7f0e-4501-b3c3-31587c3a5092 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:01.579583 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e0a24182-7f0e-4501-b3c3-31587c3a5092 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:01.580019 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e0a24182-7f0e-4501-b3c3-31587c3a5092 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:01.580555 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-e0a24182-7f0e-4501-b3c3-31587c3a5092 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lazy-loading 'fault' on Instance uuid e1d26e71-34c0-4d7a-9d84-e1925fd3656a {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:38:01.619830 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e0a24182-7f0e-4501-b3c3-31587c3a5092 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:38:01.627545 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e0a24182-7f0e-4501-b3c3-31587c3a5092 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a" status: 200 len: 1308 microversion: 2.1 time: 0.089661 Oct 12 18:38:01.628112 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 683/1376] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:38:01 2021] GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a => generated 1308 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:38:02.645000 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-ccd3ead5-e9ce-4e12-ba86-2a76c0e487bd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:38:02.645690 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-ccd3ead5-e9ce-4e12-ba86-2a76c0e487bd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: e1d26e71-34c0-4d7a-9d84-e1925fd3656a] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:38:02.651947 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ccd3ead5-e9ce-4e12-ba86-2a76c0e487bd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:02.652440 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ccd3ead5-e9ce-4e12-ba86-2a76c0e487bd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:02.653207 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ccd3ead5-e9ce-4e12-ba86-2a76c0e487bd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:02.653629 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ccd3ead5-e9ce-4e12-ba86-2a76c0e487bd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:02.666498 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.wsgi [None req-ccd3ead5-e9ce-4e12-ba86-2a76c0e487bd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] HTTP exception thrown: Instance e1d26e71-34c0-4d7a-9d84-e1925fd3656a could not be found. Oct 12 18:38:02.667059 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-ccd3ead5-e9ce-4e12-ba86-2a76c0e487bd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Returning 404 to user: Instance e1d26e71-34c0-4d7a-9d84-e1925fd3656a could not be found. {{(pid=109169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:38:02.668340 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-ccd3ead5-e9ce-4e12-ba86-2a76c0e487bd tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a" status: 404 len: 111 microversion: 2.1 time: 0.026794 Oct 12 18:38:02.670375 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 694/1377] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:38:02 2021] GET /compute/v2.1/servers/e1d26e71-34c0-4d7a-9d84-e1925fd3656a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:38:02.677035 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1e9e1a7f-7cb3-4394-9613-9ac01e10cfdf tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:38:02.677545 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1e9e1a7f-7cb3-4394-9613-9ac01e10cfdf tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 95e86945-e809-401e-9a1a-7c506f4d847f] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:38:02.684571 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1e9e1a7f-7cb3-4394-9613-9ac01e10cfdf tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:02.685009 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1e9e1a7f-7cb3-4394-9613-9ac01e10cfdf tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:02.685761 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1e9e1a7f-7cb3-4394-9613-9ac01e10cfdf tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:02.686187 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1e9e1a7f-7cb3-4394-9613-9ac01e10cfdf tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:02.712251 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1e9e1a7f-7cb3-4394-9613-9ac01e10cfdf tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 95e86945-e809-401e-9a1a-7c506f4d847f] Going to try to terminate instance {{(pid=109168) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 18:38:03.043992 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1e9e1a7f-7cb3-4394-9613-9ac01e10cfdf tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "DELETE /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f" status: 204 len: 0 microversion: 2.1 time: 0.370360 Oct 12 18:38:03.044613 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 684/1378] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Oct 12 18:38:02 2021] DELETE /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 18:38:03.052860 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-817b5e05-0a73-46a5-8a06-d7ebf4630f63 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:38:03.053469 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-817b5e05-0a73-46a5-8a06-d7ebf4630f63 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 95e86945-e809-401e-9a1a-7c506f4d847f] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:38:03.059378 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-817b5e05-0a73-46a5-8a06-d7ebf4630f63 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:03.059825 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-817b5e05-0a73-46a5-8a06-d7ebf4630f63 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:03.063322 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-817b5e05-0a73-46a5-8a06-d7ebf4630f63 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:03.063322 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-817b5e05-0a73-46a5-8a06-d7ebf4630f63 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:03.180636 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-817b5e05-0a73-46a5-8a06-d7ebf4630f63 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:38:03.187885 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-817b5e05-0a73-46a5-8a06-d7ebf4630f63 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f" status: 200 len: 1513 microversion: 2.1 time: 0.138590 Oct 12 18:38:03.188448 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 695/1379] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:38:03 2021] GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f => generated 1513 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:38:04.204748 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-fc89317e-8cdb-4376-9930-7c5ca0977bc2 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:38:04.248380 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-fc89317e-8cdb-4376-9930-7c5ca0977bc2 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 95e86945-e809-401e-9a1a-7c506f4d847f] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:38:04.248380 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fc89317e-8cdb-4376-9930-7c5ca0977bc2 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:04.248380 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fc89317e-8cdb-4376-9930-7c5ca0977bc2 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:04.248380 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fc89317e-8cdb-4376-9930-7c5ca0977bc2 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:04.248793 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fc89317e-8cdb-4376-9930-7c5ca0977bc2 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:04.341562 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-fc89317e-8cdb-4376-9930-7c5ca0977bc2 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:38:04.348912 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-fc89317e-8cdb-4376-9930-7c5ca0977bc2 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f" status: 200 len: 1513 microversion: 2.1 time: 0.148226 Oct 12 18:38:04.349452 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 685/1380] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:38:04 2021] GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:38:05.365837 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-eb6f5f37-ba91-4aff-89e7-d1d5a454a673 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:38:05.366436 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-eb6f5f37-ba91-4aff-89e7-d1d5a454a673 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 95e86945-e809-401e-9a1a-7c506f4d847f] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:38:05.372157 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-eb6f5f37-ba91-4aff-89e7-d1d5a454a673 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:05.372633 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-eb6f5f37-ba91-4aff-89e7-d1d5a454a673 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:05.373412 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-eb6f5f37-ba91-4aff-89e7-d1d5a454a673 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:05.373835 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-eb6f5f37-ba91-4aff-89e7-d1d5a454a673 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:05.536884 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-fe35e1f7-9bbb-410d-a5ce-1eb64f80de75 req-048e2a5a-e17a-49e7-b5fa-c1a1afa07aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e86945-e809-401e-9a1a-7c506f4d847f", "name": "network-vif-deleted", "tag": "a254d8df-215f-4c79-ac60-a5b25f3bb041"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:38:05.539010 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:38:05.539010 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:38:05.546701 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-fe35e1f7-9bbb-410d-a5ce-1eb64f80de75 req-048e2a5a-e17a-49e7-b5fa-c1a1afa07aa4 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:05.547136 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-fe35e1f7-9bbb-410d-a5ce-1eb64f80de75 req-048e2a5a-e17a-49e7-b5fa-c1a1afa07aa4 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:05.564326 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-fe35e1f7-9bbb-410d-a5ce-1eb64f80de75 req-048e2a5a-e17a-49e7-b5fa-c1a1afa07aa4 service nova] Creating event network-vif-deleted:a254d8df-215f-4c79-ac60-a5b25f3bb041 for instance 95e86945-e809-401e-9a1a-7c506f4d847f on hv-cinder-81322 Oct 12 18:38:05.564326 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-fe35e1f7-9bbb-410d-a5ce-1eb64f80de75 req-048e2a5a-e17a-49e7-b5fa-c1a1afa07aa4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030971 Oct 12 18:38:05.564992 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 686/1381] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:38:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:38:05.591398 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-eb6f5f37-ba91-4aff-89e7-d1d5a454a673 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:38:05.600541 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-eb6f5f37-ba91-4aff-89e7-d1d5a454a673 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f" status: 200 len: 1513 microversion: 2.1 time: 0.237726 Oct 12 18:38:05.600664 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 696/1382] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:38:05 2021] GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f => generated 1513 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:38:06.617768 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-fc237b2b-bc50-46aa-a4ec-1af552b50eab tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:38:06.618550 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-fc237b2b-bc50-46aa-a4ec-1af552b50eab tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: 95e86945-e809-401e-9a1a-7c506f4d847f] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:38:06.625274 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fc237b2b-bc50-46aa-a4ec-1af552b50eab tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:06.626015 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fc237b2b-bc50-46aa-a4ec-1af552b50eab tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:06.626858 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fc237b2b-bc50-46aa-a4ec-1af552b50eab tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:06.627351 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fc237b2b-bc50-46aa-a4ec-1af552b50eab tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:06.640816 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-fc237b2b-bc50-46aa-a4ec-1af552b50eab tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] HTTP exception thrown: Instance 95e86945-e809-401e-9a1a-7c506f4d847f could not be found. Oct 12 18:38:06.641467 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-fc237b2b-bc50-46aa-a4ec-1af552b50eab tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Returning 404 to user: Instance 95e86945-e809-401e-9a1a-7c506f4d847f could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:38:06.642353 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-fc237b2b-bc50-46aa-a4ec-1af552b50eab tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f" status: 404 len: 111 microversion: 2.1 time: 0.028860 Oct 12 18:38:06.642959 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 687/1383] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:38:06 2021] GET /compute/v2.1/servers/95e86945-e809-401e-9a1a-7c506f4d847f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:38:07.922243 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-68529e80-a6bb-4544-9f3d-c98bea87a663 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:38:07.922723 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-68529e80-a6bb-4544-9f3d-c98bea87a663 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: c441c901-c4e6-43f0-8136-f138ee030430] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:38:07.928526 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-68529e80-a6bb-4544-9f3d-c98bea87a663 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:07.928978 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-68529e80-a6bb-4544-9f3d-c98bea87a663 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:07.929732 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-68529e80-a6bb-4544-9f3d-c98bea87a663 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:07.930161 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-68529e80-a6bb-4544-9f3d-c98bea87a663 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:07.955119 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-68529e80-a6bb-4544-9f3d-c98bea87a663 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: c441c901-c4e6-43f0-8136-f138ee030430] Going to try to terminate instance {{(pid=109169) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 18:38:08.202757 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-68529e80-a6bb-4544-9f3d-c98bea87a663 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430" status: 204 len: 0 microversion: 2.1 time: 0.284362 Oct 12 18:38:08.203280 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 697/1384] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Oct 12 18:38:07 2021] DELETE /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 18:38:08.212866 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7cd1f710-17fa-4754-8c91-d69cf44857bb tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:38:08.216911 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7cd1f710-17fa-4754-8c91-d69cf44857bb tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: c441c901-c4e6-43f0-8136-f138ee030430] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:38:08.222774 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7cd1f710-17fa-4754-8c91-d69cf44857bb tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:08.223213 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7cd1f710-17fa-4754-8c91-d69cf44857bb tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:08.223982 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7cd1f710-17fa-4754-8c91-d69cf44857bb tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:08.224438 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7cd1f710-17fa-4754-8c91-d69cf44857bb tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:08.359313 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7cd1f710-17fa-4754-8c91-d69cf44857bb tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:38:08.366588 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7cd1f710-17fa-4754-8c91-d69cf44857bb tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430" status: 200 len: 1512 microversion: 2.1 time: 0.159035 Oct 12 18:38:08.367141 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 688/1385] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:38:08 2021] GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:38:09.312788 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-ece88489-7f8e-4940-99eb-7b4420d66911 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:38:09.313381 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-ece88489-7f8e-4940-99eb-7b4420d66911 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:38:09.326947 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ece88489-7f8e-4940-99eb-7b4420d66911 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:09.328509 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ece88489-7f8e-4940-99eb-7b4420d66911 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:09.329867 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ece88489-7f8e-4940-99eb-7b4420d66911 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:09.330308 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-ece88489-7f8e-4940-99eb-7b4420d66911 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:09.360374 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-ece88489-7f8e-4940-99eb-7b4420d66911 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7] Going to try to terminate instance {{(pid=109169) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 18:38:09.452435 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-9fd49f67-0266-4f05-8430-ddd7060173fc req-7d675d75-6a37-46c8-97e7-1b686cd57d66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7", "tag": "6b64a2da-1847-42d7-b301-103470a2877a"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:38:09.454078 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:38:09.454078 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:38:09.461380 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-9fd49f67-0266-4f05-8430-ddd7060173fc req-7d675d75-6a37-46c8-97e7-1b686cd57d66 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:09.461824 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-9fd49f67-0266-4f05-8430-ddd7060173fc req-7d675d75-6a37-46c8-97e7-1b686cd57d66 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:09.474144 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-9fd49f67-0266-4f05-8430-ddd7060173fc req-7d675d75-6a37-46c8-97e7-1b686cd57d66 service nova] Creating event network-changed:6b64a2da-1847-42d7-b301-103470a2877a for instance 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 on hv-cinder-81322 Oct 12 18:38:09.479139 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-9fd49f67-0266-4f05-8430-ddd7060173fc req-7d675d75-6a37-46c8-97e7-1b686cd57d66 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167422 Oct 12 18:38:09.479742 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 689/1386] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:38:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:38:09.485470 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0480ea49-cd2f-457e-99e1-5f9b56936309 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:38:09.486179 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0480ea49-cd2f-457e-99e1-5f9b56936309 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: c441c901-c4e6-43f0-8136-f138ee030430] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:38:09.496229 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0480ea49-cd2f-457e-99e1-5f9b56936309 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:09.504641 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0480ea49-cd2f-457e-99e1-5f9b56936309 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:09.504641 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0480ea49-cd2f-457e-99e1-5f9b56936309 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:09.504641 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0480ea49-cd2f-457e-99e1-5f9b56936309 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:09.723931 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0480ea49-cd2f-457e-99e1-5f9b56936309 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:38:09.733031 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0480ea49-cd2f-457e-99e1-5f9b56936309 tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430" status: 200 len: 1512 microversion: 2.1 time: 0.250329 Oct 12 18:38:09.734330 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 690/1387] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:38:09 2021] GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430 => generated 1512 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:38:09.741925 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-ece88489-7f8e-4940-99eb-7b4420d66911 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "DELETE /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7" status: 204 len: 0 microversion: 2.1 time: 0.432882 Oct 12 18:38:09.742816 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 698/1388] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Oct 12 18:38:09 2021] DELETE /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 18:38:09.751582 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-72208027-eb38-463c-b919-bfe61f07f62d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:38:09.752351 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-72208027-eb38-463c-b919-bfe61f07f62d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:38:09.759990 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-72208027-eb38-463c-b919-bfe61f07f62d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:09.760568 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-72208027-eb38-463c-b919-bfe61f07f62d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:09.761594 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-72208027-eb38-463c-b919-bfe61f07f62d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:09.762237 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-72208027-eb38-463c-b919-bfe61f07f62d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:09.979820 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-72208027-eb38-463c-b919-bfe61f07f62d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:38:09.988154 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-72208027-eb38-463c-b919-bfe61f07f62d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7" status: 200 len: 1576 microversion: 2.1 time: 0.240299 Oct 12 18:38:09.993498 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 691/1389] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:38:09 2021] GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 => generated 1576 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:38:10.751165 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-4206f63e-f3ca-4181-880c-272a5053e00f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:38:10.751946 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-4206f63e-f3ca-4181-880c-272a5053e00f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: c441c901-c4e6-43f0-8136-f138ee030430] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:38:10.758091 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4206f63e-f3ca-4181-880c-272a5053e00f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:10.758751 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4206f63e-f3ca-4181-880c-272a5053e00f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:10.759530 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4206f63e-f3ca-4181-880c-272a5053e00f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:10.759965 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4206f63e-f3ca-4181-880c-272a5053e00f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:10.827881 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-4206f63e-f3ca-4181-880c-272a5053e00f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75606513d1c04a9a8f95e0c0f60d9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b114869544b4236a53ce1103cfc7abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:38:10.835304 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-4206f63e-f3ca-4181-880c-272a5053e00f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430" status: 200 len: 1470 microversion: 2.1 time: 0.088344 Oct 12 18:38:10.835984 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 699/1390] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:38:10 2021] GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430 => generated 1470 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:38:11.006747 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9cb5c195-8aa4-4106-8840-d70fd4238002 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:38:11.007492 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9cb5c195-8aa4-4106-8840-d70fd4238002 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:38:11.014036 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9cb5c195-8aa4-4106-8840-d70fd4238002 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:11.014479 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9cb5c195-8aa4-4106-8840-d70fd4238002 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:11.015230 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9cb5c195-8aa4-4106-8840-d70fd4238002 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:11.015678 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9cb5c195-8aa4-4106-8840-d70fd4238002 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:11.138566 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9cb5c195-8aa4-4106-8840-d70fd4238002 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:38:11.145779 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9cb5c195-8aa4-4106-8840-d70fd4238002 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7" status: 200 len: 1458 microversion: 2.1 time: 0.142705 Oct 12 18:38:11.146342 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 692/1391] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:38:11 2021] GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 => generated 1458 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:38:11.496271 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-039b4f12-e0e4-437a-b459-b733723b5ab5 req-41ad0139-f7c4-40b5-a600-e13fdc9731dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c441c901-c4e6-43f0-8136-f138ee030430", "name": "network-vif-deleted", "tag": "192f9164-f1d6-4259-8c18-d220be03c0d9"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:38:11.498323 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:38:11.498323 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:38:11.505043 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-039b4f12-e0e4-437a-b459-b733723b5ab5 req-41ad0139-f7c4-40b5-a600-e13fdc9731dd service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:11.505489 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-039b4f12-e0e4-437a-b459-b733723b5ab5 req-41ad0139-f7c4-40b5-a600-e13fdc9731dd service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:11.516529 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-039b4f12-e0e4-437a-b459-b733723b5ab5 req-41ad0139-f7c4-40b5-a600-e13fdc9731dd service nova] Creating event network-vif-deleted:192f9164-f1d6-4259-8c18-d220be03c0d9 for instance c441c901-c4e6-43f0-8136-f138ee030430 on hv-cinder-81322 Oct 12 18:38:11.521253 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-039b4f12-e0e4-437a-b459-b733723b5ab5 req-41ad0139-f7c4-40b5-a600-e13fdc9731dd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028724 Oct 12 18:38:11.522973 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 700/1392] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:38:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 18:38:11.852215 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-45981668-d691-4926-8923-9225d3c8925f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:38:11.852864 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-45981668-d691-4926-8923-9225d3c8925f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] [instance: c441c901-c4e6-43f0-8136-f138ee030430] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:38:11.859946 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-45981668-d691-4926-8923-9225d3c8925f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:11.859946 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-45981668-d691-4926-8923-9225d3c8925f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:11.860475 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-45981668-d691-4926-8923-9225d3c8925f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:11.860911 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-45981668-d691-4926-8923-9225d3c8925f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:11.874640 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-45981668-d691-4926-8923-9225d3c8925f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] HTTP exception thrown: Instance c441c901-c4e6-43f0-8136-f138ee030430 could not be found. Oct 12 18:38:11.875221 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-45981668-d691-4926-8923-9225d3c8925f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] Returning 404 to user: Instance c441c901-c4e6-43f0-8136-f138ee030430 could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:38:11.876042 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-45981668-d691-4926-8923-9225d3c8925f tempest-AttachVolumeNegativeTest-1016244354 tempest-AttachVolumeNegativeTest-1016244354-project] 10.222.0.18 "GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430" status: 404 len: 111 microversion: 2.1 time: 0.027471 Oct 12 18:38:11.876608 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 693/1393] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:38:11 2021] GET /compute/v2.1/servers/c441c901-c4e6-43f0-8136-f138ee030430 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:38:12.163702 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-8b637b72-ec44-493e-8234-a4c295caf66d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:38:12.164388 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-8b637b72-ec44-493e-8234-a4c295caf66d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:38:12.170991 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8b637b72-ec44-493e-8234-a4c295caf66d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:12.171433 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8b637b72-ec44-493e-8234-a4c295caf66d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:12.172212 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8b637b72-ec44-493e-8234-a4c295caf66d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:12.172723 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8b637b72-ec44-493e-8234-a4c295caf66d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:12.232428 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-8b637b72-ec44-493e-8234-a4c295caf66d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:38:12.240123 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-8b637b72-ec44-493e-8234-a4c295caf66d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7" status: 200 len: 1390 microversion: 2.1 time: 0.080104 Oct 12 18:38:12.240681 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 701/1394] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:38:12 2021] GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:38:13.257195 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ef7dcd70-db39-4b3e-86b3-42030010ffd1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:38:13.257870 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ef7dcd70-db39-4b3e-86b3-42030010ffd1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:38:13.264393 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ef7dcd70-db39-4b3e-86b3-42030010ffd1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:13.264867 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ef7dcd70-db39-4b3e-86b3-42030010ffd1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:13.265633 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ef7dcd70-db39-4b3e-86b3-42030010ffd1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:13.266057 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ef7dcd70-db39-4b3e-86b3-42030010ffd1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:13.298275 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ef7dcd70-db39-4b3e-86b3-42030010ffd1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:13.298724 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ef7dcd70-db39-4b3e-86b3-42030010ffd1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:13.299163 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-ef7dcd70-db39-4b3e-86b3-42030010ffd1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lazy-loading 'fault' on Instance uuid 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:38:13.339503 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ef7dcd70-db39-4b3e-86b3-42030010ffd1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:38:13.346772 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ef7dcd70-db39-4b3e-86b3-42030010ffd1 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7" status: 200 len: 1229 microversion: 2.1 time: 0.093377 Oct 12 18:38:13.347725 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 694/1395] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:38:13 2021] GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 => generated 1229 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:38:13.536151 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-1f6b65e4-ac8e-4480-b8c2-dcd08852db44 req-5266f76b-dcaa-43a3-bf9d-1e9aef5b14da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7", "name": "network-vif-deleted", "tag": "6b64a2da-1847-42d7-b301-103470a2877a"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:38:13.537703 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:38:13.537703 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:38:13.544967 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-1f6b65e4-ac8e-4480-b8c2-dcd08852db44 req-5266f76b-dcaa-43a3-bf9d-1e9aef5b14da service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:13.545453 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-1f6b65e4-ac8e-4480-b8c2-dcd08852db44 req-5266f76b-dcaa-43a3-bf9d-1e9aef5b14da service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:13.556007 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-1f6b65e4-ac8e-4480-b8c2-dcd08852db44 req-5266f76b-dcaa-43a3-bf9d-1e9aef5b14da service nova] Creating event network-vif-deleted:6b64a2da-1847-42d7-b301-103470a2877a for instance 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 on hv-cinder-81322 Oct 12 18:38:13.561103 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-1f6b65e4-ac8e-4480-b8c2-dcd08852db44 req-5266f76b-dcaa-43a3-bf9d-1e9aef5b14da service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028479 Oct 12 18:38:13.561689 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 702/1396] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:38:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:38:14.363455 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ed5a5487-947e-4a57-a5f3-950b1292cdd8 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:38:14.364090 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ed5a5487-947e-4a57-a5f3-950b1292cdd8 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:38:14.370425 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ed5a5487-947e-4a57-a5f3-950b1292cdd8 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:14.370870 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ed5a5487-947e-4a57-a5f3-950b1292cdd8 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:14.371630 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ed5a5487-947e-4a57-a5f3-950b1292cdd8 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:14.372647 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ed5a5487-947e-4a57-a5f3-950b1292cdd8 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:14.386608 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-ed5a5487-947e-4a57-a5f3-950b1292cdd8 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] HTTP exception thrown: Instance 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 could not be found. Oct 12 18:38:14.387191 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ed5a5487-947e-4a57-a5f3-950b1292cdd8 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Returning 404 to user: Instance 96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:38:14.388698 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ed5a5487-947e-4a57-a5f3-950b1292cdd8 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7" status: 404 len: 111 microversion: 2.1 time: 0.028319 Oct 12 18:38:14.393027 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 695/1397] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:38:14 2021] GET /compute/v2.1/servers/96a2f2c7-3e94-4ee2-abc5-5c7f0e33b9b7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:38:17.792053 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-b190c68f-441e-496f-9389-848ee0f71f77 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:38:17.792854 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-b190c68f-441e-496f-9389-848ee0f71f77 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 527d2718-c3be-44f9-bf49-9c445e98cc75] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:38:17.798330 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-eb5e84c2-cb07-4b02-b67d-1756858a58e3 req-6c5abd6e-dc22-4a74-8036-5b2e27029e7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "527d2718-c3be-44f9-bf49-9c445e98cc75", "tag": "260f73ad-348d-4e3f-8940-94a948e1eaae"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:38:17.802419 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:38:17.802419 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:38:17.811507 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-eb5e84c2-cb07-4b02-b67d-1756858a58e3 req-6c5abd6e-dc22-4a74-8036-5b2e27029e7c service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:17.812068 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-eb5e84c2-cb07-4b02-b67d-1756858a58e3 req-6c5abd6e-dc22-4a74-8036-5b2e27029e7c service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:17.816138 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b190c68f-441e-496f-9389-848ee0f71f77 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:17.816635 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b190c68f-441e-496f-9389-848ee0f71f77 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:17.817550 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b190c68f-441e-496f-9389-848ee0f71f77 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:17.817981 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-b190c68f-441e-496f-9389-848ee0f71f77 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:17.824804 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-eb5e84c2-cb07-4b02-b67d-1756858a58e3 req-6c5abd6e-dc22-4a74-8036-5b2e27029e7c service nova] Creating event network-changed:260f73ad-348d-4e3f-8940-94a948e1eaae for instance 527d2718-c3be-44f9-bf49-9c445e98cc75 on hv-cinder-81322 Oct 12 18:38:17.830663 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-eb5e84c2-cb07-4b02-b67d-1756858a58e3 req-6c5abd6e-dc22-4a74-8036-5b2e27029e7c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036240 Oct 12 18:38:17.831613 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 696/1398] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:38:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:38:17.860036 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-b190c68f-441e-496f-9389-848ee0f71f77 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 527d2718-c3be-44f9-bf49-9c445e98cc75] Going to try to terminate instance {{(pid=109169) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 18:38:18.238507 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-b190c68f-441e-496f-9389-848ee0f71f77 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "DELETE /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75" status: 204 len: 0 microversion: 2.1 time: 0.450536 Oct 12 18:38:18.239102 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 703/1399] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Oct 12 18:38:17 2021] DELETE /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 18:38:18.248700 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-aea01ff9-e770-4567-94b3-eaf95cc39979 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:38:18.249421 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-aea01ff9-e770-4567-94b3-eaf95cc39979 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 527d2718-c3be-44f9-bf49-9c445e98cc75] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:38:18.255380 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-aea01ff9-e770-4567-94b3-eaf95cc39979 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:18.255821 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-aea01ff9-e770-4567-94b3-eaf95cc39979 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:18.256615 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-aea01ff9-e770-4567-94b3-eaf95cc39979 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:18.257047 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-aea01ff9-e770-4567-94b3-eaf95cc39979 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:18.391371 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-aea01ff9-e770-4567-94b3-eaf95cc39979 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:38:18.402540 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-aea01ff9-e770-4567-94b3-eaf95cc39979 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75" status: 200 len: 1578 microversion: 2.1 time: 0.157778 Oct 12 18:38:18.422228 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 697/1400] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:38:18 2021] GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75 => generated 1578 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:38:19.423973 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-4a00eb9f-817a-4f92-b2fa-114bdaac8f99 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:38:19.423973 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-4a00eb9f-817a-4f92-b2fa-114bdaac8f99 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 527d2718-c3be-44f9-bf49-9c445e98cc75] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:38:19.434932 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4a00eb9f-817a-4f92-b2fa-114bdaac8f99 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:19.437751 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4a00eb9f-817a-4f92-b2fa-114bdaac8f99 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:19.439335 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4a00eb9f-817a-4f92-b2fa-114bdaac8f99 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:19.439335 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4a00eb9f-817a-4f92-b2fa-114bdaac8f99 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:19.522743 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-4a00eb9f-817a-4f92-b2fa-114bdaac8f99 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:38:19.530036 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-4a00eb9f-817a-4f92-b2fa-114bdaac8f99 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75" status: 200 len: 1391 microversion: 2.1 time: 0.112021 Oct 12 18:38:19.530643 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 704/1401] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:38:19 2021] GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75 => generated 1391 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:38:19.846118 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-0ebd585b-21eb-48f8-a317-39821fff0275 req-221bb7fa-9235-4eff-8100-b0aa2984294e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "527d2718-c3be-44f9-bf49-9c445e98cc75", "name": "network-vif-deleted", "tag": "260f73ad-348d-4e3f-8940-94a948e1eaae"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:38:19.847881 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:38:19.847881 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:38:19.854780 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-0ebd585b-21eb-48f8-a317-39821fff0275 req-221bb7fa-9235-4eff-8100-b0aa2984294e service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:19.855225 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-0ebd585b-21eb-48f8-a317-39821fff0275 req-221bb7fa-9235-4eff-8100-b0aa2984294e service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:19.866912 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-0ebd585b-21eb-48f8-a317-39821fff0275 req-221bb7fa-9235-4eff-8100-b0aa2984294e service nova] Creating event network-vif-deleted:260f73ad-348d-4e3f-8940-94a948e1eaae for instance 527d2718-c3be-44f9-bf49-9c445e98cc75 on hv-cinder-81322 Oct 12 18:38:19.871936 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-0ebd585b-21eb-48f8-a317-39821fff0275 req-221bb7fa-9235-4eff-8100-b0aa2984294e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029458 Oct 12 18:38:19.873149 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 698/1402] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:38:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:38:20.547797 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c65e181e-a237-4ae7-b613-945251fb1375 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:38:20.548418 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c65e181e-a237-4ae7-b613-945251fb1375 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 527d2718-c3be-44f9-bf49-9c445e98cc75] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:38:20.554161 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c65e181e-a237-4ae7-b613-945251fb1375 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:20.562286 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c65e181e-a237-4ae7-b613-945251fb1375 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:20.562286 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c65e181e-a237-4ae7-b613-945251fb1375 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:20.562286 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c65e181e-a237-4ae7-b613-945251fb1375 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:20.586215 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c65e181e-a237-4ae7-b613-945251fb1375 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:20.586478 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c65e181e-a237-4ae7-b613-945251fb1375 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:20.586925 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.objects.instance [None req-c65e181e-a237-4ae7-b613-945251fb1375 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lazy-loading 'fault' on Instance uuid 527d2718-c3be-44f9-bf49-9c445e98cc75 {{(pid=109169) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:38:20.629188 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c65e181e-a237-4ae7-b613-945251fb1375 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a37985dd5034ceeabfa47797efba5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b808c36ccd4256858530aedc0a6f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:38:20.636434 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c65e181e-a237-4ae7-b613-945251fb1375 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75" status: 200 len: 1230 microversion: 2.1 time: 0.092871 Oct 12 18:38:20.636985 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 705/1403] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:38:20 2021] GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75 => generated 1230 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:38:21.654758 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b93c0dcc-e95b-4e5a-9c5d-a136c80d47af tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:38:21.656352 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b93c0dcc-e95b-4e5a-9c5d-a136c80d47af tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: 527d2718-c3be-44f9-bf49-9c445e98cc75] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:38:21.661710 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b93c0dcc-e95b-4e5a-9c5d-a136c80d47af tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:21.662150 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b93c0dcc-e95b-4e5a-9c5d-a136c80d47af tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:21.662978 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b93c0dcc-e95b-4e5a-9c5d-a136c80d47af tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:21.663405 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b93c0dcc-e95b-4e5a-9c5d-a136c80d47af tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:21.677304 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-b93c0dcc-e95b-4e5a-9c5d-a136c80d47af tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] HTTP exception thrown: Instance 527d2718-c3be-44f9-bf49-9c445e98cc75 could not be found. Oct 12 18:38:21.677867 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b93c0dcc-e95b-4e5a-9c5d-a136c80d47af tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Returning 404 to user: Instance 527d2718-c3be-44f9-bf49-9c445e98cc75 could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:38:21.678661 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b93c0dcc-e95b-4e5a-9c5d-a136c80d47af tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75" status: 404 len: 111 microversion: 2.1 time: 0.028060 Oct 12 18:38:21.679174 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 699/1404] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:38:21 2021] GET /compute/v2.1/servers/527d2718-c3be-44f9-bf49-9c445e98cc75 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:38:22.346652 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-447b6edd-a7e9-46cf-ab2a-fa5686203d91 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:38:22.347332 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-447b6edd-a7e9-46cf-ab2a-fa5686203d91 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:38:22.353231 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-447b6edd-a7e9-46cf-ab2a-fa5686203d91 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:22.353681 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-447b6edd-a7e9-46cf-ab2a-fa5686203d91 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:22.354451 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-447b6edd-a7e9-46cf-ab2a-fa5686203d91 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:22.354880 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-447b6edd-a7e9-46cf-ab2a-fa5686203d91 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:22.368963 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.wsgi [None req-447b6edd-a7e9-46cf-ab2a-fa5686203d91 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] HTTP exception thrown: Instance ff8be5be-6f8c-42e2-9cd4-10c62915f993 could not be found. Oct 12 18:38:22.369550 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-447b6edd-a7e9-46cf-ab2a-fa5686203d91 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Returning 404 to user: Instance ff8be5be-6f8c-42e2-9cd4-10c62915f993 could not be found. {{(pid=109169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:38:22.370365 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-447b6edd-a7e9-46cf-ab2a-fa5686203d91 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 404 len: 111 microversion: 2.1 time: 0.027526 Oct 12 18:38:22.370913 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 706/1405] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Oct 12 18:38:22 2021] DELETE /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:38:22.379613 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c6000a31-0fc8-4044-98ed-8f459b10dc69 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:38:22.380231 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c6000a31-0fc8-4044-98ed-8f459b10dc69 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] [instance: ff8be5be-6f8c-42e2-9cd4-10c62915f993] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:38:22.393000 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c6000a31-0fc8-4044-98ed-8f459b10dc69 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:22.393000 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c6000a31-0fc8-4044-98ed-8f459b10dc69 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:22.393000 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c6000a31-0fc8-4044-98ed-8f459b10dc69 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:22.393000 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c6000a31-0fc8-4044-98ed-8f459b10dc69 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:22.401227 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-c6000a31-0fc8-4044-98ed-8f459b10dc69 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] HTTP exception thrown: Instance ff8be5be-6f8c-42e2-9cd4-10c62915f993 could not be found. Oct 12 18:38:22.401818 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c6000a31-0fc8-4044-98ed-8f459b10dc69 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Returning 404 to user: Instance ff8be5be-6f8c-42e2-9cd4-10c62915f993 could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:38:22.402640 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c6000a31-0fc8-4044-98ed-8f459b10dc69 tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993" status: 404 len: 111 microversion: 2.1 time: 0.026790 Oct 12 18:38:22.403285 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 700/1406] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:38:22 2021] GET /compute/v2.1/servers/ff8be5be-6f8c-42e2-9cd4-10c62915f993 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:38:23.923880 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-20cef6f4-e967-4603-9da1-5b2f2287d27d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] Calling method '.version_select at 0x7fe297be9700>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:38:24.033922 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-20cef6f4-e967-4603-9da1-5b2f2287d27d tempest-TestVolumeBootPattern-1135832167 tempest-TestVolumeBootPattern-1135832167-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-800000789" status: 202 len: 0 microversion: 2.1 time: 0.113768 Oct 12 18:38:24.034606 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 707/1407] 10.222.0.18 () {58 vars in 1259 bytes} [Tue Oct 12 18:38:23 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-800000789 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:38:54.196831 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 18:38:54.197352 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: Tue Oct 12 18:38:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 12 18:38:57.204112 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8ac4f541-c911-4b62-bb46-45324d186ece tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1294247570", "imageRef": "c79f0511-74c5-46f3-a7e6-cde6b09234ee", "flavorRef": "452"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:38:57.252887 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.network.neutron [None req-8ac4f541-c911-4b62-bb46-45324d186ece tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] validate_networks() for None {{(pid=109168) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 18:38:57.512576 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-8ac4f541-c911-4b62-bb46-45324d186ece tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Flavor limits 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 18:38:57.513003 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-8ac4f541-c911-4b62-bb46-45324d186ece tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Image limits 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 18:38:57.513478 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-8ac4f541-c911-4b62-bb46-45324d186ece tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Flavor pref 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 18:38:57.513889 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-8ac4f541-c911-4b62-bb46-45324d186ece tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Image pref 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 18:38:57.514301 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-8ac4f541-c911-4b62-bb46-45324d186ece tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 18:38:57.523392 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8ac4f541-c911-4b62-bb46-45324d186ece tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:57.523837 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8ac4f541-c911-4b62-bb46-45324d186ece tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:57.524702 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8ac4f541-c911-4b62-bb46-45324d186ece tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:57.525138 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8ac4f541-c911-4b62-bb46-45324d186ece tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:57.540879 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-8ac4f541-c911-4b62-bb46-45324d186ece tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Getting quotas for project de4e840d77e543a5b8086a8ea2388d0d. Resources: {'instances', 'cores', 'ram'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:38:57.544630 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-8ac4f541-c911-4b62-bb46-45324d186ece tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Getting quotas for user 9299d54930d64d41ae33bab98ca7fd41 and project de4e840d77e543a5b8086a8ea2388d0d. Resources: {'instances', 'cores', 'ram'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:38:57.554768 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8ac4f541-c911-4b62-bb46-45324d186ece tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Going to run 1 instances... {{(pid=109168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 18:38:57.557051 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8ac4f541-c911-4b62-bb46-45324d186ece tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] [instance: 9b8a9c81-be38-4ce7-825a-212cb39783bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c79f0511-74c5-46f3-a7e6-cde6b09234ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 18:38:57.728322 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8ac4f541-c911-4b62-bb46-45324d186ece tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524045 Oct 12 18:38:57.728322 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 701/1408] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Oct 12 18:38:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 18:38:57.737520 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-f3200cab-0483-46b6-b1d0-d451c0c43b6b tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:38:57.738126 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-f3200cab-0483-46b6-b1d0-d451c0c43b6b tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] [instance: 9b8a9c81-be38-4ce7-825a-212cb39783bf] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:38:57.788409 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-f3200cab-0483-46b6-b1d0-d451c0c43b6b tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9299d54930d64d41ae33bab98ca7fd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de4e840d77e543a5b8086a8ea2388d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:38:57.795807 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-f3200cab-0483-46b6-b1d0-d451c0c43b6b tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] 10.222.0.18 "GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf" status: 200 len: 1215 microversion: 2.1 time: 0.062693 Oct 12 18:38:57.796363 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 708/1409] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:38:57 2021] GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf => generated 1215 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:38:58.811998 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-dc419083-b61f-43c8-8b6b-9c123c65518d tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:38:58.812630 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-dc419083-b61f-43c8-8b6b-9c123c65518d tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] [instance: 9b8a9c81-be38-4ce7-825a-212cb39783bf] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:38:58.818465 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dc419083-b61f-43c8-8b6b-9c123c65518d tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:58.818904 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dc419083-b61f-43c8-8b6b-9c123c65518d tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:58.819843 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dc419083-b61f-43c8-8b6b-9c123c65518d tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:58.820269 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dc419083-b61f-43c8-8b6b-9c123c65518d tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:58.890275 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-dc419083-b61f-43c8-8b6b-9c123c65518d tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9299d54930d64d41ae33bab98ca7fd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de4e840d77e543a5b8086a8ea2388d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:38:58.897772 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-dc419083-b61f-43c8-8b6b-9c123c65518d tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] 10.222.0.18 "GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf" status: 200 len: 1219 microversion: 2.1 time: 0.089380 Oct 12 18:38:58.898320 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 702/1410] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:38:58 2021] GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:38:59.914869 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-4749377d-3e5c-4b06-b56b-82470d4814c1 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:38:59.915454 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-4749377d-3e5c-4b06-b56b-82470d4814c1 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] [instance: 9b8a9c81-be38-4ce7-825a-212cb39783bf] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:38:59.921248 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4749377d-3e5c-4b06-b56b-82470d4814c1 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:59.926160 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4749377d-3e5c-4b06-b56b-82470d4814c1 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:59.926160 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4749377d-3e5c-4b06-b56b-82470d4814c1 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:38:59.926160 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4749377d-3e5c-4b06-b56b-82470d4814c1 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:38:59.987020 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-4749377d-3e5c-4b06-b56b-82470d4814c1 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9299d54930d64d41ae33bab98ca7fd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de4e840d77e543a5b8086a8ea2388d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:38:59.996989 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-4749377d-3e5c-4b06-b56b-82470d4814c1 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] 10.222.0.18 "GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf" status: 200 len: 1275 microversion: 2.1 time: 0.086601 Oct 12 18:38:59.997728 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 709/1411] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:38:59 2021] GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf => generated 1275 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:39:01.015261 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5a05cb14-8894-44bb-aed4-cf1a41f46747 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:01.016298 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5a05cb14-8894-44bb-aed4-cf1a41f46747 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] [instance: 9b8a9c81-be38-4ce7-825a-212cb39783bf] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:01.022266 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5a05cb14-8894-44bb-aed4-cf1a41f46747 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:01.022772 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5a05cb14-8894-44bb-aed4-cf1a41f46747 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:01.023550 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5a05cb14-8894-44bb-aed4-cf1a41f46747 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:01.023979 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5a05cb14-8894-44bb-aed4-cf1a41f46747 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:01.082946 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5a05cb14-8894-44bb-aed4-cf1a41f46747 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9299d54930d64d41ae33bab98ca7fd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de4e840d77e543a5b8086a8ea2388d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:01.090041 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5a05cb14-8894-44bb-aed4-cf1a41f46747 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] 10.222.0.18 "GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf" status: 200 len: 1273 microversion: 2.1 time: 0.079054 Oct 12 18:39:01.090588 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 703/1412] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:01 2021] GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf => generated 1273 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:39:02.107046 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-df7d1ea4-3e24-4689-8479-ffc377274793 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:02.107825 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-df7d1ea4-3e24-4689-8479-ffc377274793 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] [instance: 9b8a9c81-be38-4ce7-825a-212cb39783bf] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:02.113492 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-df7d1ea4-3e24-4689-8479-ffc377274793 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:02.116367 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-df7d1ea4-3e24-4689-8479-ffc377274793 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:02.116367 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-df7d1ea4-3e24-4689-8479-ffc377274793 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:02.116367 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-df7d1ea4-3e24-4689-8479-ffc377274793 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:02.137658 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-a8012619-692b-4495-9a30-1aefbe28ba3a req-db99449b-6ae0-4c0b-ac6a-b0ccbbe47a3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b8a9c81-be38-4ce7-825a-212cb39783bf", "tag": "97a77269-c779-4df5-bc8b-c7c597b625e4"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:39:02.141598 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:39:02.141598 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:39:02.151475 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-a8012619-692b-4495-9a30-1aefbe28ba3a req-db99449b-6ae0-4c0b-ac6a-b0ccbbe47a3d service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:02.151927 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-a8012619-692b-4495-9a30-1aefbe28ba3a req-db99449b-6ae0-4c0b-ac6a-b0ccbbe47a3d service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:02.168351 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-a8012619-692b-4495-9a30-1aefbe28ba3a req-db99449b-6ae0-4c0b-ac6a-b0ccbbe47a3d service nova] Creating event network-changed:97a77269-c779-4df5-bc8b-c7c597b625e4 for instance 9b8a9c81-be38-4ce7-825a-212cb39783bf on hv-cinder-81322 Oct 12 18:39:02.173574 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-a8012619-692b-4495-9a30-1aefbe28ba3a req-db99449b-6ae0-4c0b-ac6a-b0ccbbe47a3d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039428 Oct 12 18:39:02.174633 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 704/1413] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:39:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:39:02.256923 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-df7d1ea4-3e24-4689-8479-ffc377274793 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9299d54930d64d41ae33bab98ca7fd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de4e840d77e543a5b8086a8ea2388d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:02.265967 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-df7d1ea4-3e24-4689-8479-ffc377274793 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] 10.222.0.18 "GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf" status: 200 len: 1315 microversion: 2.1 time: 0.161668 Oct 12 18:39:02.266919 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 710/1414] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:02 2021] GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:39:03.283611 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-38d4c9eb-72a7-463c-9c9a-5c45e42f1558 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:03.284333 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-38d4c9eb-72a7-463c-9c9a-5c45e42f1558 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] [instance: 9b8a9c81-be38-4ce7-825a-212cb39783bf] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:03.290337 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-38d4c9eb-72a7-463c-9c9a-5c45e42f1558 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:03.290777 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-38d4c9eb-72a7-463c-9c9a-5c45e42f1558 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:03.291533 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-38d4c9eb-72a7-463c-9c9a-5c45e42f1558 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:03.291962 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-38d4c9eb-72a7-463c-9c9a-5c45e42f1558 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:03.410470 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-38d4c9eb-72a7-463c-9c9a-5c45e42f1558 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9299d54930d64d41ae33bab98ca7fd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de4e840d77e543a5b8086a8ea2388d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:03.417781 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-38d4c9eb-72a7-463c-9c9a-5c45e42f1558 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] 10.222.0.18 "GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf" status: 200 len: 1315 microversion: 2.1 time: 0.138424 Oct 12 18:39:03.418333 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 705/1415] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:03 2021] GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf => generated 1315 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:39:04.433579 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-e5be4ee1-7373-4eba-b163-d4f61532cf38 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:04.434179 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-e5be4ee1-7373-4eba-b163-d4f61532cf38 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] [instance: 9b8a9c81-be38-4ce7-825a-212cb39783bf] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:04.439875 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e5be4ee1-7373-4eba-b163-d4f61532cf38 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:04.440314 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e5be4ee1-7373-4eba-b163-d4f61532cf38 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:04.441098 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e5be4ee1-7373-4eba-b163-d4f61532cf38 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:04.441524 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-e5be4ee1-7373-4eba-b163-d4f61532cf38 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:04.557020 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-e5be4ee1-7373-4eba-b163-d4f61532cf38 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9299d54930d64d41ae33bab98ca7fd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de4e840d77e543a5b8086a8ea2388d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:04.564006 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-e5be4ee1-7373-4eba-b163-d4f61532cf38 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] 10.222.0.18 "GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf" status: 200 len: 1315 microversion: 2.1 time: 0.134141 Oct 12 18:39:04.564604 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 711/1416] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:04 2021] GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf => generated 1315 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:39:05.579811 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2fda1262-4bc1-44f1-a61c-ba8349bc03c8 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:05.580435 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2fda1262-4bc1-44f1-a61c-ba8349bc03c8 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] [instance: 9b8a9c81-be38-4ce7-825a-212cb39783bf] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:05.586192 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2fda1262-4bc1-44f1-a61c-ba8349bc03c8 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:05.586639 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2fda1262-4bc1-44f1-a61c-ba8349bc03c8 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:05.587397 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2fda1262-4bc1-44f1-a61c-ba8349bc03c8 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:05.587829 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2fda1262-4bc1-44f1-a61c-ba8349bc03c8 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:05.711098 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2fda1262-4bc1-44f1-a61c-ba8349bc03c8 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9299d54930d64d41ae33bab98ca7fd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de4e840d77e543a5b8086a8ea2388d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:05.718326 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2fda1262-4bc1-44f1-a61c-ba8349bc03c8 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] 10.222.0.18 "GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf" status: 200 len: 1315 microversion: 2.1 time: 0.142215 Oct 12 18:39:05.720940 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 706/1417] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:05 2021] GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf => generated 1315 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:39:06.735516 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-12047461-5ace-4078-9274-be89dc7e863d tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:06.736152 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-12047461-5ace-4078-9274-be89dc7e863d tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] [instance: 9b8a9c81-be38-4ce7-825a-212cb39783bf] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:06.742455 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-12047461-5ace-4078-9274-be89dc7e863d tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:06.742892 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-12047461-5ace-4078-9274-be89dc7e863d tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:06.743645 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-12047461-5ace-4078-9274-be89dc7e863d tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:06.744073 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-12047461-5ace-4078-9274-be89dc7e863d tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:06.860798 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-12047461-5ace-4078-9274-be89dc7e863d tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9299d54930d64d41ae33bab98ca7fd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de4e840d77e543a5b8086a8ea2388d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:06.868500 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-12047461-5ace-4078-9274-be89dc7e863d tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] 10.222.0.18 "GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf" status: 200 len: 1315 microversion: 2.1 time: 0.136595 Oct 12 18:39:06.869056 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 712/1418] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:06 2021] GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf => generated 1315 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:39:07.885695 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9fbc19de-6c5a-43c7-8907-e1bcac833baa tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:07.886219 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9fbc19de-6c5a-43c7-8907-e1bcac833baa tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] [instance: 9b8a9c81-be38-4ce7-825a-212cb39783bf] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:07.891950 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9fbc19de-6c5a-43c7-8907-e1bcac833baa tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:07.892392 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9fbc19de-6c5a-43c7-8907-e1bcac833baa tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:07.893174 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9fbc19de-6c5a-43c7-8907-e1bcac833baa tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:07.893603 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9fbc19de-6c5a-43c7-8907-e1bcac833baa tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:08.016160 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9fbc19de-6c5a-43c7-8907-e1bcac833baa tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9299d54930d64d41ae33bab98ca7fd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de4e840d77e543a5b8086a8ea2388d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:08.023840 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9fbc19de-6c5a-43c7-8907-e1bcac833baa tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] 10.222.0.18 "GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf" status: 200 len: 1315 microversion: 2.1 time: 0.141856 Oct 12 18:39:08.024420 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 707/1419] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:07 2021] GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf => generated 1315 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:39:09.041424 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-7baf0a02-2de8-4fa6-a453-498f67ebfc03 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:09.042030 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-7baf0a02-2de8-4fa6-a453-498f67ebfc03 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] [instance: 9b8a9c81-be38-4ce7-825a-212cb39783bf] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:09.048156 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7baf0a02-2de8-4fa6-a453-498f67ebfc03 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:09.048630 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7baf0a02-2de8-4fa6-a453-498f67ebfc03 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:09.049382 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7baf0a02-2de8-4fa6-a453-498f67ebfc03 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:09.049812 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-7baf0a02-2de8-4fa6-a453-498f67ebfc03 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:09.169443 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-7baf0a02-2de8-4fa6-a453-498f67ebfc03 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9299d54930d64d41ae33bab98ca7fd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de4e840d77e543a5b8086a8ea2388d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:09.176376 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-7baf0a02-2de8-4fa6-a453-498f67ebfc03 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] 10.222.0.18 "GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf" status: 200 len: 1315 microversion: 2.1 time: 0.138578 Oct 12 18:39:09.176974 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 713/1420] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:09 2021] GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf => generated 1315 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:39:10.193293 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4e6da443-a546-4b0d-8b13-108ed8175cdb tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:10.194403 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4e6da443-a546-4b0d-8b13-108ed8175cdb tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] [instance: 9b8a9c81-be38-4ce7-825a-212cb39783bf] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:10.200129 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4e6da443-a546-4b0d-8b13-108ed8175cdb tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:10.200606 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4e6da443-a546-4b0d-8b13-108ed8175cdb tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:10.201359 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4e6da443-a546-4b0d-8b13-108ed8175cdb tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:10.201785 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4e6da443-a546-4b0d-8b13-108ed8175cdb tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:10.317419 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4e6da443-a546-4b0d-8b13-108ed8175cdb tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9299d54930d64d41ae33bab98ca7fd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de4e840d77e543a5b8086a8ea2388d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:10.325092 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4e6da443-a546-4b0d-8b13-108ed8175cdb tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] 10.222.0.18 "GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf" status: 200 len: 1315 microversion: 2.1 time: 0.135521 Oct 12 18:39:10.325651 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 708/1421] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:10 2021] GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf => generated 1315 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:39:11.341697 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-027e2e94-2e2b-468b-b958-5d89296d9d27 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:11.342433 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-027e2e94-2e2b-468b-b958-5d89296d9d27 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] [instance: 9b8a9c81-be38-4ce7-825a-212cb39783bf] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:11.348179 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-027e2e94-2e2b-468b-b958-5d89296d9d27 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:11.348719 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-027e2e94-2e2b-468b-b958-5d89296d9d27 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:11.349406 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-027e2e94-2e2b-468b-b958-5d89296d9d27 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:11.349861 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-027e2e94-2e2b-468b-b958-5d89296d9d27 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:11.473480 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-027e2e94-2e2b-468b-b958-5d89296d9d27 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9299d54930d64d41ae33bab98ca7fd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de4e840d77e543a5b8086a8ea2388d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:11.481083 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-027e2e94-2e2b-468b-b958-5d89296d9d27 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] 10.222.0.18 "GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf" status: 200 len: 1315 microversion: 2.1 time: 0.142987 Oct 12 18:39:11.481640 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 714/1422] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:11 2021] GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf => generated 1315 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:39:12.322229 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-33be9006-e82a-44ea-b8cf-b7f7a0b0541a req-3d6c4336-d945-471b-8abf-c9ad7f69191e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b8a9c81-be38-4ce7-825a-212cb39783bf", "name": "network-vif-plugged", "status": "completed", "tag": "97a77269-c779-4df5-bc8b-c7c597b625e4"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:39:12.323727 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:39:12.323727 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:39:12.330511 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-33be9006-e82a-44ea-b8cf-b7f7a0b0541a req-3d6c4336-d945-471b-8abf-c9ad7f69191e service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:12.330941 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-33be9006-e82a-44ea-b8cf-b7f7a0b0541a req-3d6c4336-d945-471b-8abf-c9ad7f69191e service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:12.342506 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-33be9006-e82a-44ea-b8cf-b7f7a0b0541a req-3d6c4336-d945-471b-8abf-c9ad7f69191e service nova] Creating event network-vif-plugged:97a77269-c779-4df5-bc8b-c7c597b625e4 for instance 9b8a9c81-be38-4ce7-825a-212cb39783bf on hv-cinder-81322 Oct 12 18:39:12.347563 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-33be9006-e82a-44ea-b8cf-b7f7a0b0541a req-3d6c4336-d945-471b-8abf-c9ad7f69191e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029378 Oct 12 18:39:12.348242 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 709/1423] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:39:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:39:12.497705 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-20b52698-2b5c-479b-8cb1-2edc297a7040 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:12.498309 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-20b52698-2b5c-479b-8cb1-2edc297a7040 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] [instance: 9b8a9c81-be38-4ce7-825a-212cb39783bf] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:12.504064 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-20b52698-2b5c-479b-8cb1-2edc297a7040 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:12.504547 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-20b52698-2b5c-479b-8cb1-2edc297a7040 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:12.505301 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-20b52698-2b5c-479b-8cb1-2edc297a7040 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:12.505728 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-20b52698-2b5c-479b-8cb1-2edc297a7040 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:12.627961 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-20b52698-2b5c-479b-8cb1-2edc297a7040 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9299d54930d64d41ae33bab98ca7fd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de4e840d77e543a5b8086a8ea2388d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:12.636095 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-20b52698-2b5c-479b-8cb1-2edc297a7040 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] 10.222.0.18 "GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf" status: 200 len: 1315 microversion: 2.1 time: 0.141936 Oct 12 18:39:12.636694 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 715/1424] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:12 2021] GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf => generated 1315 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 18:39:13.654169 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-bf9c6524-d660-4a7e-bcbc-d71ba3368cb4 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:13.654848 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-bf9c6524-d660-4a7e-bcbc-d71ba3368cb4 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] [instance: 9b8a9c81-be38-4ce7-825a-212cb39783bf] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:13.661039 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bf9c6524-d660-4a7e-bcbc-d71ba3368cb4 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:13.661464 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bf9c6524-d660-4a7e-bcbc-d71ba3368cb4 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:13.662216 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bf9c6524-d660-4a7e-bcbc-d71ba3368cb4 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:13.662829 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bf9c6524-d660-4a7e-bcbc-d71ba3368cb4 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:13.784061 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-bf9c6524-d660-4a7e-bcbc-d71ba3368cb4 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9299d54930d64d41ae33bab98ca7fd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de4e840d77e543a5b8086a8ea2388d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:13.791654 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-bf9c6524-d660-4a7e-bcbc-d71ba3368cb4 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] 10.222.0.18 "GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf" status: 200 len: 1315 microversion: 2.1 time: 0.141361 Oct 12 18:39:13.792221 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 710/1425] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:13 2021] GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf => generated 1315 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:39:14.808240 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-a0da8947-b6bd-4543-a98a-af5412e320c9 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:14.810076 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-a0da8947-b6bd-4543-a98a-af5412e320c9 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] [instance: 9b8a9c81-be38-4ce7-825a-212cb39783bf] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:14.814534 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a0da8947-b6bd-4543-a98a-af5412e320c9 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:14.814979 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a0da8947-b6bd-4543-a98a-af5412e320c9 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:14.815735 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a0da8947-b6bd-4543-a98a-af5412e320c9 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:14.816167 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-a0da8947-b6bd-4543-a98a-af5412e320c9 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:14.933846 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-a0da8947-b6bd-4543-a98a-af5412e320c9 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9299d54930d64d41ae33bab98ca7fd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de4e840d77e543a5b8086a8ea2388d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:14.941092 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-a0da8947-b6bd-4543-a98a-af5412e320c9 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] 10.222.0.18 "GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf" status: 200 len: 1465 microversion: 2.1 time: 0.136551 Oct 12 18:39:14.941659 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 716/1426] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:14 2021] GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf => generated 1465 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:39:14.977957 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a66868e0-4ee9-477c-b3d1-35d9699a4721 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:14.978465 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a66868e0-4ee9-477c-b3d1-35d9699a4721 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] [instance: 9b8a9c81-be38-4ce7-825a-212cb39783bf] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:14.984035 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a66868e0-4ee9-477c-b3d1-35d9699a4721 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:14.984509 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a66868e0-4ee9-477c-b3d1-35d9699a4721 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:14.985276 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a66868e0-4ee9-477c-b3d1-35d9699a4721 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:14.985705 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a66868e0-4ee9-477c-b3d1-35d9699a4721 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:15.009957 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a66868e0-4ee9-477c-b3d1-35d9699a4721 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] [instance: 9b8a9c81-be38-4ce7-825a-212cb39783bf] Going to try to terminate instance {{(pid=109168) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 18:39:15.368261 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a66868e0-4ee9-477c-b3d1-35d9699a4721 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf" status: 204 len: 0 microversion: 2.1 time: 0.394207 Oct 12 18:39:15.368875 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 711/1427] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Oct 12 18:39:14 2021] DELETE /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 18:39:15.376723 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-3040748c-2179-4ca1-b47f-b8398a307ac8 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:15.377337 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-3040748c-2179-4ca1-b47f-b8398a307ac8 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] [instance: 9b8a9c81-be38-4ce7-825a-212cb39783bf] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:15.383706 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3040748c-2179-4ca1-b47f-b8398a307ac8 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:15.384146 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3040748c-2179-4ca1-b47f-b8398a307ac8 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:15.384945 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3040748c-2179-4ca1-b47f-b8398a307ac8 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:15.385374 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3040748c-2179-4ca1-b47f-b8398a307ac8 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:15.505866 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-3040748c-2179-4ca1-b47f-b8398a307ac8 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9299d54930d64d41ae33bab98ca7fd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de4e840d77e543a5b8086a8ea2388d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:15.513030 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-3040748c-2179-4ca1-b47f-b8398a307ac8 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] 10.222.0.18 "GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf" status: 200 len: 1471 microversion: 2.1 time: 0.139858 Oct 12 18:39:15.513593 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 717/1428] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:15 2021] GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf => generated 1471 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:39:16.532471 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-24706293-6cf6-4d32-8f49-37796d45c747 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:16.533487 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-24706293-6cf6-4d32-8f49-37796d45c747 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] [instance: 9b8a9c81-be38-4ce7-825a-212cb39783bf] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:16.540809 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-24706293-6cf6-4d32-8f49-37796d45c747 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:16.541254 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-24706293-6cf6-4d32-8f49-37796d45c747 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:16.542025 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-24706293-6cf6-4d32-8f49-37796d45c747 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:16.542454 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-24706293-6cf6-4d32-8f49-37796d45c747 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:16.666659 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-24706293-6cf6-4d32-8f49-37796d45c747 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9299d54930d64d41ae33bab98ca7fd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de4e840d77e543a5b8086a8ea2388d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:16.675205 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-24706293-6cf6-4d32-8f49-37796d45c747 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] 10.222.0.18 "GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf" status: 200 len: 1471 microversion: 2.1 time: 0.148211 Oct 12 18:39:16.676018 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 712/1429] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:16 2021] GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf => generated 1471 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:39:17.347512 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-af068ea0-3412-41d6-a0bb-bbe73c2a89f3 req-bf051549-6abc-4fab-8a45-2211e0c950a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b8a9c81-be38-4ce7-825a-212cb39783bf", "name": "network-vif-deleted", "tag": "97a77269-c779-4df5-bc8b-c7c597b625e4"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:39:17.349086 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:39:17.349086 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:39:17.357224 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-af068ea0-3412-41d6-a0bb-bbe73c2a89f3 req-bf051549-6abc-4fab-8a45-2211e0c950a6 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:17.357661 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-af068ea0-3412-41d6-a0bb-bbe73c2a89f3 req-bf051549-6abc-4fab-8a45-2211e0c950a6 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:17.370366 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-af068ea0-3412-41d6-a0bb-bbe73c2a89f3 req-bf051549-6abc-4fab-8a45-2211e0c950a6 service nova] Creating event network-vif-deleted:97a77269-c779-4df5-bc8b-c7c597b625e4 for instance 9b8a9c81-be38-4ce7-825a-212cb39783bf on hv-cinder-81322 Oct 12 18:39:17.378035 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-af068ea0-3412-41d6-a0bb-bbe73c2a89f3 req-bf051549-6abc-4fab-8a45-2211e0c950a6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031936 Oct 12 18:39:17.378035 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 718/1430] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:39:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:39:17.692461 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4616679f-d263-471d-ae89-20c6fd74a17a tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:17.693075 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4616679f-d263-471d-ae89-20c6fd74a17a tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] [instance: 9b8a9c81-be38-4ce7-825a-212cb39783bf] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:17.698775 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4616679f-d263-471d-ae89-20c6fd74a17a tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:17.699218 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4616679f-d263-471d-ae89-20c6fd74a17a tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:17.700015 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4616679f-d263-471d-ae89-20c6fd74a17a tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:17.700454 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4616679f-d263-471d-ae89-20c6fd74a17a tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:17.731854 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4616679f-d263-471d-ae89-20c6fd74a17a tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:17.732297 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4616679f-d263-471d-ae89-20c6fd74a17a tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:17.732777 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-4616679f-d263-471d-ae89-20c6fd74a17a tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lazy-loading 'fault' on Instance uuid 9b8a9c81-be38-4ce7-825a-212cb39783bf {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:39:17.770219 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4616679f-d263-471d-ae89-20c6fd74a17a tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9299d54930d64d41ae33bab98ca7fd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de4e840d77e543a5b8086a8ea2388d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:17.778157 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4616679f-d263-471d-ae89-20c6fd74a17a tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] 10.222.0.18 "GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf" status: 200 len: 1305 microversion: 2.1 time: 0.089323 Oct 12 18:39:17.778712 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 713/1431] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:17 2021] GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf => generated 1305 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:39:18.795901 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-69a8f5be-3bc1-47c1-904a-9fbd1b8fd491 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:18.796733 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-69a8f5be-3bc1-47c1-904a-9fbd1b8fd491 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] [instance: 9b8a9c81-be38-4ce7-825a-212cb39783bf] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:18.802992 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-69a8f5be-3bc1-47c1-904a-9fbd1b8fd491 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:18.803451 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-69a8f5be-3bc1-47c1-904a-9fbd1b8fd491 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:18.804234 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-69a8f5be-3bc1-47c1-904a-9fbd1b8fd491 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:18.804691 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-69a8f5be-3bc1-47c1-904a-9fbd1b8fd491 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:18.818966 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.wsgi [None req-69a8f5be-3bc1-47c1-904a-9fbd1b8fd491 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] HTTP exception thrown: Instance 9b8a9c81-be38-4ce7-825a-212cb39783bf could not be found. Oct 12 18:39:18.819617 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-69a8f5be-3bc1-47c1-904a-9fbd1b8fd491 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] Returning 404 to user: Instance 9b8a9c81-be38-4ce7-825a-212cb39783bf could not be found. {{(pid=109169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:39:18.820462 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-69a8f5be-3bc1-47c1-904a-9fbd1b8fd491 tempest-VolumesNegativeTest-951479180 tempest-VolumesNegativeTest-951479180-project] 10.222.0.18 "GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf" status: 404 len: 111 microversion: 2.1 time: 0.028620 Oct 12 18:39:18.821098 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 719/1432] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:18 2021] GET /compute/v2.1/servers/9b8a9c81-be38-4ce7-825a-212cb39783bf => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:39:40.343983 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8b1a2b03-328c-41b5-880c-a8e727d44c7e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Action: 'create', calling method: .version_select at 0x7fe297b50700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-433301441"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:39:40.360756 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-8b1a2b03-328c-41b5-880c-a8e727d44c7e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Getting quotas for project 8636fe098af34b33b41c75cf2f0072d5. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:39:40.364425 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-8b1a2b03-328c-41b5-880c-a8e727d44c7e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Getting quotas for user 80631cd055354ed8ba8fa7888e4e319c and project 8636fe098af34b33b41c75cf2f0072d5. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:39:40.534706 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-8b1a2b03-328c-41b5-880c-a8e727d44c7e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Getting quotas for project 8636fe098af34b33b41c75cf2f0072d5. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:39:40.538831 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-8b1a2b03-328c-41b5-880c-a8e727d44c7e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Getting quotas for user 80631cd055354ed8ba8fa7888e4e319c and project 8636fe098af34b33b41c75cf2f0072d5. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:39:40.550937 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8b1a2b03-328c-41b5-880c-a8e727d44c7e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.210844 Oct 12 18:39:40.551515 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 714/1433] 10.222.0.18 () {60 vars in 1157 bytes} [Tue Oct 12 18:39:40 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:39:40.598678 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-0ecbbdf6-18b2-4325-bfd3-f46caa5d4948 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1949300674", "imageRef": "a62a97a6-d2f7-4283-855b-e0546620c42f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-433301441", "networks": [{"uuid": "3d0573ae-2da0-4453-9bd0-f9ed20787481"}]}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:39:40.650760 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.network.neutron [None req-0ecbbdf6-18b2-4325-bfd3-f46caa5d4948 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] validate_networks() for [('3d0573ae-2da0-4453-9bd0-f9ed20787481', None, None, None, None, None)] {{(pid=109169) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 18:39:41.008158 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-0ecbbdf6-18b2-4325-bfd3-f46caa5d4948 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Flavor limits 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 18:39:41.008611 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-0ecbbdf6-18b2-4325-bfd3-f46caa5d4948 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Image limits 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 18:39:41.009078 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-0ecbbdf6-18b2-4325-bfd3-f46caa5d4948 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Flavor pref 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 18:39:41.009476 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-0ecbbdf6-18b2-4325-bfd3-f46caa5d4948 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Image pref 0:0:0 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 18:39:41.009878 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.virt.hardware [None req-0ecbbdf6-18b2-4325-bfd3-f46caa5d4948 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 18:39:41.018433 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0ecbbdf6-18b2-4325-bfd3-f46caa5d4948 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:41.018870 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0ecbbdf6-18b2-4325-bfd3-f46caa5d4948 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:41.019652 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0ecbbdf6-18b2-4325-bfd3-f46caa5d4948 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:41.020231 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0ecbbdf6-18b2-4325-bfd3-f46caa5d4948 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:41.036724 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.quota [None req-0ecbbdf6-18b2-4325-bfd3-f46caa5d4948 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Getting quotas for project 8636fe098af34b33b41c75cf2f0072d5. Resources: {'instances', 'cores', 'ram'} {{(pid=109169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 18:39:41.041285 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.quota [None req-0ecbbdf6-18b2-4325-bfd3-f46caa5d4948 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Getting quotas for user 80631cd055354ed8ba8fa7888e4e319c and project 8636fe098af34b33b41c75cf2f0072d5. Resources: {'instances', 'cores', 'ram'} {{(pid=109169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 18:39:41.051784 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-0ecbbdf6-18b2-4325-bfd3-f46caa5d4948 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Going to run 1 instances... {{(pid=109169) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 18:39:41.054163 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-0ecbbdf6-18b2-4325-bfd3-f46caa5d4948 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a62a97a6-d2f7-4283-855b-e0546620c42f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109169) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 18:39:41.185649 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-0ecbbdf6-18b2-4325-bfd3-f46caa5d4948 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590688 Oct 12 18:39:41.186449 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 720/1434] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Oct 12 18:39:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 18:39:41.195902 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c8ec8153-efd8-4013-9ebf-820750a94b60 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:41.196663 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c8ec8153-efd8-4013-9ebf-820750a94b60 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:41.248857 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c8ec8153-efd8-4013-9ebf-820750a94b60 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:41.255246 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c8ec8153-efd8-4013-9ebf-820750a94b60 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1258 microversion: 2.1 time: 0.063102 Oct 12 18:39:41.255795 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 715/1435] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:41 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1258 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:39:42.272007 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-4395cd8c-7f52-452a-9dc6-c6b14d587adc tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:42.272748 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-4395cd8c-7f52-452a-9dc6-c6b14d587adc tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:42.323360 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-4395cd8c-7f52-452a-9dc6-c6b14d587adc tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:42.330482 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-4395cd8c-7f52-452a-9dc6-c6b14d587adc tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1258 microversion: 2.1 time: 0.062098 Oct 12 18:39:42.330968 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 721/1436] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:42 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1258 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:39:43.346041 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-6a15fb95-bb58-4a87-84bd-3034db527158 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:43.346691 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-6a15fb95-bb58-4a87-84bd-3034db527158 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:43.353200 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6a15fb95-bb58-4a87-84bd-3034db527158 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:43.353647 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6a15fb95-bb58-4a87-84bd-3034db527158 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:43.354414 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6a15fb95-bb58-4a87-84bd-3034db527158 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:43.354847 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6a15fb95-bb58-4a87-84bd-3034db527158 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:43.414839 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-6a15fb95-bb58-4a87-84bd-3034db527158 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:43.422034 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-6a15fb95-bb58-4a87-84bd-3034db527158 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1254 microversion: 2.1 time: 0.079587 Oct 12 18:39:43.422604 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 716/1437] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:43 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1254 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:39:44.442443 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-56734b4c-d053-44fb-b526-3ce01b451b8d tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:44.443052 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-56734b4c-d053-44fb-b526-3ce01b451b8d tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:44.449136 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-56734b4c-d053-44fb-b526-3ce01b451b8d tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:44.449857 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-56734b4c-d053-44fb-b526-3ce01b451b8d tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:44.450855 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-56734b4c-d053-44fb-b526-3ce01b451b8d tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:44.451495 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-56734b4c-d053-44fb-b526-3ce01b451b8d tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:44.513619 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-56734b4c-d053-44fb-b526-3ce01b451b8d tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:44.520738 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-56734b4c-d053-44fb-b526-3ce01b451b8d tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1316 microversion: 2.1 time: 0.082091 Oct 12 18:39:44.521312 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 722/1438] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:44 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1316 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:39:45.537735 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1e75898c-9f2d-4f5d-b38e-159be63bdd8b tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:45.538893 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1e75898c-9f2d-4f5d-b38e-159be63bdd8b tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:45.544678 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1e75898c-9f2d-4f5d-b38e-159be63bdd8b tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:45.545122 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1e75898c-9f2d-4f5d-b38e-159be63bdd8b tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:45.545879 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1e75898c-9f2d-4f5d-b38e-159be63bdd8b tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:45.546393 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1e75898c-9f2d-4f5d-b38e-159be63bdd8b tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:45.839124 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1e75898c-9f2d-4f5d-b38e-159be63bdd8b tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:45.846319 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1e75898c-9f2d-4f5d-b38e-159be63bdd8b tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1358 microversion: 2.1 time: 0.312222 Oct 12 18:39:45.846889 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 717/1439] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:45 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1358 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:39:46.862857 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-81bb5d3c-7327-4a4c-9c4b-3828f06f03cf tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:46.863438 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-81bb5d3c-7327-4a4c-9c4b-3828f06f03cf tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:46.870553 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-81bb5d3c-7327-4a4c-9c4b-3828f06f03cf tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:46.870917 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-81bb5d3c-7327-4a4c-9c4b-3828f06f03cf tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:46.871710 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-81bb5d3c-7327-4a4c-9c4b-3828f06f03cf tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:46.872132 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-81bb5d3c-7327-4a4c-9c4b-3828f06f03cf tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:46.997248 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-81bb5d3c-7327-4a4c-9c4b-3828f06f03cf tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:47.004732 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-81bb5d3c-7327-4a4c-9c4b-3828f06f03cf tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1358 microversion: 2.1 time: 0.145501 Oct 12 18:39:47.005504 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 723/1440] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:46 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:39:48.021861 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f180e6d1-8229-4083-8d1b-a65f3c543362 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:48.022653 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f180e6d1-8229-4083-8d1b-a65f3c543362 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:48.028594 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f180e6d1-8229-4083-8d1b-a65f3c543362 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:48.029035 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f180e6d1-8229-4083-8d1b-a65f3c543362 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:48.029806 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f180e6d1-8229-4083-8d1b-a65f3c543362 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:48.030233 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f180e6d1-8229-4083-8d1b-a65f3c543362 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:48.157649 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f180e6d1-8229-4083-8d1b-a65f3c543362 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:48.164730 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f180e6d1-8229-4083-8d1b-a65f3c543362 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1358 microversion: 2.1 time: 0.146614 Oct 12 18:39:48.165270 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 718/1441] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:48 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:39:49.182848 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-cacc1a3d-190a-41b3-91e5-93db40f0fdeb tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:49.183580 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-cacc1a3d-190a-41b3-91e5-93db40f0fdeb tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:49.189491 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cacc1a3d-190a-41b3-91e5-93db40f0fdeb tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:49.189929 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cacc1a3d-190a-41b3-91e5-93db40f0fdeb tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:49.190692 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cacc1a3d-190a-41b3-91e5-93db40f0fdeb tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:49.191119 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-cacc1a3d-190a-41b3-91e5-93db40f0fdeb tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:49.317064 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-cacc1a3d-190a-41b3-91e5-93db40f0fdeb tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:49.324528 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-cacc1a3d-190a-41b3-91e5-93db40f0fdeb tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1358 microversion: 2.1 time: 0.145292 Oct 12 18:39:49.325101 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 724/1442] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:49 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:39:50.341488 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0dc5f33c-37c6-4559-9043-4d014b4425bc tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:50.342098 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0dc5f33c-37c6-4559-9043-4d014b4425bc tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:50.347916 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0dc5f33c-37c6-4559-9043-4d014b4425bc tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:50.359943 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0dc5f33c-37c6-4559-9043-4d014b4425bc tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:50.359943 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0dc5f33c-37c6-4559-9043-4d014b4425bc tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:50.359943 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0dc5f33c-37c6-4559-9043-4d014b4425bc tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:50.471559 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0dc5f33c-37c6-4559-9043-4d014b4425bc tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:50.479836 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0dc5f33c-37c6-4559-9043-4d014b4425bc tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1358 microversion: 2.1 time: 0.141932 Oct 12 18:39:50.480414 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 719/1443] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:50 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1358 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:39:51.498060 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-3c0f9751-bbf5-41ee-a981-38fd08e2fbcf tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:51.498796 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-3c0f9751-bbf5-41ee-a981-38fd08e2fbcf tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:51.504869 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3c0f9751-bbf5-41ee-a981-38fd08e2fbcf tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:51.505337 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3c0f9751-bbf5-41ee-a981-38fd08e2fbcf tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:51.506191 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3c0f9751-bbf5-41ee-a981-38fd08e2fbcf tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:51.506660 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3c0f9751-bbf5-41ee-a981-38fd08e2fbcf tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:51.642214 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-3c0f9751-bbf5-41ee-a981-38fd08e2fbcf tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:51.650859 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-3c0f9751-bbf5-41ee-a981-38fd08e2fbcf tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1358 microversion: 2.1 time: 0.156403 Oct 12 18:39:51.651520 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 725/1444] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:51 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:39:52.664795 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: ERROR oslo.messaging._drivers.impl_rabbit [-] [95de5915-31ff-43be-b304-c8b7292b5453] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 18:39:52.668074 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-905d1fe5-777b-4310-a060-59258b6a930e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:52.668718 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-905d1fe5-777b-4310-a060-59258b6a930e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:52.674669 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-905d1fe5-777b-4310-a060-59258b6a930e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:52.675112 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-905d1fe5-777b-4310-a060-59258b6a930e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:52.675885 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-905d1fe5-777b-4310-a060-59258b6a930e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:52.676323 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-905d1fe5-777b-4310-a060-59258b6a930e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:52.807392 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-905d1fe5-777b-4310-a060-59258b6a930e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:52.814761 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-905d1fe5-777b-4310-a060-59258b6a930e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1358 microversion: 2.1 time: 0.151552 Oct 12 18:39:52.815318 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 720/1445] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:52 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:39:53.831859 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c90de20e-9a1c-4315-a5ee-be04fb6e58c0 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:53.832795 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c90de20e-9a1c-4315-a5ee-be04fb6e58c0 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:53.839121 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c90de20e-9a1c-4315-a5ee-be04fb6e58c0 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:53.842240 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c90de20e-9a1c-4315-a5ee-be04fb6e58c0 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:53.842240 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c90de20e-9a1c-4315-a5ee-be04fb6e58c0 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:53.842240 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c90de20e-9a1c-4315-a5ee-be04fb6e58c0 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:53.972186 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c90de20e-9a1c-4315-a5ee-be04fb6e58c0 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:53.980237 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c90de20e-9a1c-4315-a5ee-be04fb6e58c0 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1358 microversion: 2.1 time: 0.152092 Oct 12 18:39:53.980846 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 726/1446] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:53 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:39:54.997660 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-62e11d0d-6f5c-4549-a360-9f9897aea3ca tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:54.998333 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-62e11d0d-6f5c-4549-a360-9f9897aea3ca tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:55.014569 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-62e11d0d-6f5c-4549-a360-9f9897aea3ca tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:55.015016 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-62e11d0d-6f5c-4549-a360-9f9897aea3ca tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:55.015813 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-62e11d0d-6f5c-4549-a360-9f9897aea3ca tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:55.016246 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-62e11d0d-6f5c-4549-a360-9f9897aea3ca tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:55.021204 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO oslo.messaging._drivers.impl_rabbit [-] [95de5915-31ff-43be-b304-c8b7292b5453] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 45760. Oct 12 18:39:55.133803 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-62e11d0d-6f5c-4549-a360-9f9897aea3ca tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:55.140854 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-62e11d0d-6f5c-4549-a360-9f9897aea3ca tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1358 microversion: 2.1 time: 0.146911 Oct 12 18:39:55.141398 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 721/1447] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:54 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:39:56.157931 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c5d47789-174b-4c42-90e1-9041922a9b86 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:56.158544 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c5d47789-174b-4c42-90e1-9041922a9b86 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:56.164564 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c5d47789-174b-4c42-90e1-9041922a9b86 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:56.165029 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c5d47789-174b-4c42-90e1-9041922a9b86 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:56.166045 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c5d47789-174b-4c42-90e1-9041922a9b86 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:56.166472 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c5d47789-174b-4c42-90e1-9041922a9b86 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:56.292428 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c5d47789-174b-4c42-90e1-9041922a9b86 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:56.302591 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c5d47789-174b-4c42-90e1-9041922a9b86 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1358 microversion: 2.1 time: 0.148523 Oct 12 18:39:56.303823 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 727/1448] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:56 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:39:57.320746 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7a926c80-9ebf-4bdd-b319-0f07d4f68e5f tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:57.321453 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7a926c80-9ebf-4bdd-b319-0f07d4f68e5f tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:57.328837 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7a926c80-9ebf-4bdd-b319-0f07d4f68e5f tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:57.329286 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7a926c80-9ebf-4bdd-b319-0f07d4f68e5f tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:57.330097 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7a926c80-9ebf-4bdd-b319-0f07d4f68e5f tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:57.330648 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7a926c80-9ebf-4bdd-b319-0f07d4f68e5f tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:57.470098 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7a926c80-9ebf-4bdd-b319-0f07d4f68e5f tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:57.477292 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7a926c80-9ebf-4bdd-b319-0f07d4f68e5f tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1358 microversion: 2.1 time: 0.161012 Oct 12 18:39:57.477845 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 722/1449] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:57 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:39:57.567681 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-d2c542ec-ffc5-46c2-ba96-2bdfe302aa6a req-3f8ca542-58ee-4e98-a4f0-7dec113d2ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23084c2f-601a-4de2-bf8f-25fce88ff02c", "tag": "8ab1a3fe-6549-471b-9b2a-fb824d78b666"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:39:57.572682 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:39:57.572682 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:39:57.579632 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-d2c542ec-ffc5-46c2-ba96-2bdfe302aa6a req-3f8ca542-58ee-4e98-a4f0-7dec113d2ad8 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:57.580245 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-d2c542ec-ffc5-46c2-ba96-2bdfe302aa6a req-3f8ca542-58ee-4e98-a4f0-7dec113d2ad8 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:57.594407 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-d2c542ec-ffc5-46c2-ba96-2bdfe302aa6a req-3f8ca542-58ee-4e98-a4f0-7dec113d2ad8 service nova] Creating event network-changed:8ab1a3fe-6549-471b-9b2a-fb824d78b666 for instance 23084c2f-601a-4de2-bf8f-25fce88ff02c on hv-cinder-81322 Oct 12 18:39:57.599554 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-d2c542ec-ffc5-46c2-ba96-2bdfe302aa6a req-3f8ca542-58ee-4e98-a4f0-7dec113d2ad8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036325 Oct 12 18:39:57.600255 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 728/1450] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:39:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:39:58.493770 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-90d866ee-0b8f-484f-92ea-6a7f035317ac tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:58.494355 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-90d866ee-0b8f-484f-92ea-6a7f035317ac tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:58.500016 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-90d866ee-0b8f-484f-92ea-6a7f035317ac tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:58.500503 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-90d866ee-0b8f-484f-92ea-6a7f035317ac tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:58.504525 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-90d866ee-0b8f-484f-92ea-6a7f035317ac tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:58.504525 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-90d866ee-0b8f-484f-92ea-6a7f035317ac tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:58.621068 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-90d866ee-0b8f-484f-92ea-6a7f035317ac tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:58.628146 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-90d866ee-0b8f-484f-92ea-6a7f035317ac tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1358 microversion: 2.1 time: 0.138030 Oct 12 18:39:58.628730 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 723/1451] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:58 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1358 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:39:59.645708 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-4a0467b7-1567-4455-ba4e-fa8beb49d128 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:39:59.646408 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-4a0467b7-1567-4455-ba4e-fa8beb49d128 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:39:59.652958 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4a0467b7-1567-4455-ba4e-fa8beb49d128 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:59.653397 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4a0467b7-1567-4455-ba4e-fa8beb49d128 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:59.654151 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4a0467b7-1567-4455-ba4e-fa8beb49d128 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:39:59.654574 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-4a0467b7-1567-4455-ba4e-fa8beb49d128 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:39:59.778209 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-4a0467b7-1567-4455-ba4e-fa8beb49d128 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:39:59.785479 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-4a0467b7-1567-4455-ba4e-fa8beb49d128 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1358 microversion: 2.1 time: 0.143899 Oct 12 18:39:59.786035 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 729/1452] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:39:59 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1358 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:40:00.802674 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-384a84a7-fd01-4a39-8a38-8b1ff5e723e9 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:40:00.803431 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-384a84a7-fd01-4a39-8a38-8b1ff5e723e9 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:40:00.809628 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-384a84a7-fd01-4a39-8a38-8b1ff5e723e9 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:40:00.810073 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-384a84a7-fd01-4a39-8a38-8b1ff5e723e9 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:40:00.810835 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-384a84a7-fd01-4a39-8a38-8b1ff5e723e9 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:40:00.811268 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-384a84a7-fd01-4a39-8a38-8b1ff5e723e9 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:40:00.928871 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-384a84a7-fd01-4a39-8a38-8b1ff5e723e9 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:40:00.936673 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-384a84a7-fd01-4a39-8a38-8b1ff5e723e9 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1358 microversion: 2.1 time: 0.137707 Oct 12 18:40:00.937230 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 724/1453] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:40:00 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1358 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:40:01.952981 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-8d897dea-58f8-418d-961c-6dcb3f36d9d9 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:40:01.953508 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-8d897dea-58f8-418d-961c-6dcb3f36d9d9 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:40:01.959329 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8d897dea-58f8-418d-961c-6dcb3f36d9d9 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:40:01.959767 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8d897dea-58f8-418d-961c-6dcb3f36d9d9 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:40:01.960543 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8d897dea-58f8-418d-961c-6dcb3f36d9d9 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:40:01.960970 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8d897dea-58f8-418d-961c-6dcb3f36d9d9 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:40:02.078347 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-8d897dea-58f8-418d-961c-6dcb3f36d9d9 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:40:02.085432 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-8d897dea-58f8-418d-961c-6dcb3f36d9d9 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1358 microversion: 2.1 time: 0.136138 Oct 12 18:40:02.086332 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 730/1454] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:40:01 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1358 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:40:02.521542 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-0afb4071-cf05-41c5-abd0-c2c3e4b5d419 req-545ce7f4-70b4-4c20-9f75-9fd56d83f1b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23084c2f-601a-4de2-bf8f-25fce88ff02c", "name": "network-vif-plugged", "status": "completed", "tag": "8ab1a3fe-6549-471b-9b2a-fb824d78b666"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:40:02.523059 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:40:02.523059 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:40:02.529730 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-0afb4071-cf05-41c5-abd0-c2c3e4b5d419 req-545ce7f4-70b4-4c20-9f75-9fd56d83f1b8 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:40:02.532631 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-0afb4071-cf05-41c5-abd0-c2c3e4b5d419 req-545ce7f4-70b4-4c20-9f75-9fd56d83f1b8 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:40:02.541326 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-0afb4071-cf05-41c5-abd0-c2c3e4b5d419 req-545ce7f4-70b4-4c20-9f75-9fd56d83f1b8 service nova] Creating event network-vif-plugged:8ab1a3fe-6549-471b-9b2a-fb824d78b666 for instance 23084c2f-601a-4de2-bf8f-25fce88ff02c on hv-cinder-81322 Oct 12 18:40:02.546239 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-0afb4071-cf05-41c5-abd0-c2c3e4b5d419 req-545ce7f4-70b4-4c20-9f75-9fd56d83f1b8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028361 Oct 12 18:40:02.546805 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 725/1455] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:40:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:40:03.101563 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-70d4fd27-00ad-466a-bb34-43534de45269 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:40:03.102109 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-70d4fd27-00ad-466a-bb34-43534de45269 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:40:03.107786 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-70d4fd27-00ad-466a-bb34-43534de45269 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:40:03.108224 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-70d4fd27-00ad-466a-bb34-43534de45269 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:40:03.109005 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-70d4fd27-00ad-466a-bb34-43534de45269 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:40:03.109433 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-70d4fd27-00ad-466a-bb34-43534de45269 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:40:03.228603 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-70d4fd27-00ad-466a-bb34-43534de45269 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:40:03.235564 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-70d4fd27-00ad-466a-bb34-43534de45269 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1358 microversion: 2.1 time: 0.137680 Oct 12 18:40:03.236123 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 731/1456] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:40:03 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1358 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:40:04.252570 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0a680b85-2f1e-4173-b955-d640b8b7cb3c tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:40:04.253312 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0a680b85-2f1e-4173-b955-d640b8b7cb3c tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:40:04.259642 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0a680b85-2f1e-4173-b955-d640b8b7cb3c tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:40:04.260087 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0a680b85-2f1e-4173-b955-d640b8b7cb3c tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:40:04.260903 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0a680b85-2f1e-4173-b955-d640b8b7cb3c tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:40:04.261336 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0a680b85-2f1e-4173-b955-d640b8b7cb3c tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:40:04.389116 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0a680b85-2f1e-4173-b955-d640b8b7cb3c tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:40:04.396391 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0a680b85-2f1e-4173-b955-d640b8b7cb3c tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1358 microversion: 2.1 time: 0.147834 Oct 12 18:40:04.396964 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 726/1457] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:40:04 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:40:05.412959 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-496c6fcd-6f58-47ec-8db6-bf58747e564e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:40:05.413557 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-496c6fcd-6f58-47ec-8db6-bf58747e564e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:40:05.420123 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-496c6fcd-6f58-47ec-8db6-bf58747e564e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:40:05.420588 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-496c6fcd-6f58-47ec-8db6-bf58747e564e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:40:05.421337 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-496c6fcd-6f58-47ec-8db6-bf58747e564e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:40:05.421801 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-496c6fcd-6f58-47ec-8db6-bf58747e564e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:40:05.538381 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-496c6fcd-6f58-47ec-8db6-bf58747e564e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:40:05.546236 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-496c6fcd-6f58-47ec-8db6-bf58747e564e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1548 microversion: 2.1 time: 0.136998 Oct 12 18:40:05.546833 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 732/1458] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:40:05 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1548 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:40:05.562032 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-236a8f23-3fc1-472b-bdd3-2180da7b5b62 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:40:05.562649 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-236a8f23-3fc1-472b-bdd3-2180da7b5b62 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:40:05.568254 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-236a8f23-3fc1-472b-bdd3-2180da7b5b62 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:40:05.568722 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-236a8f23-3fc1-472b-bdd3-2180da7b5b62 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:40:05.569475 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-236a8f23-3fc1-472b-bdd3-2180da7b5b62 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:40:05.569899 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-236a8f23-3fc1-472b-bdd3-2180da7b5b62 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:40:05.690331 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-236a8f23-3fc1-472b-bdd3-2180da7b5b62 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:40:05.697501 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-236a8f23-3fc1-472b-bdd3-2180da7b5b62 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1548 microversion: 2.1 time: 0.139013 Oct 12 18:40:05.698059 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 727/1459] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:40:05 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1548 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:40:05.712590 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-3e8f231a-a271-4cea-9369-748db33c39d4 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:40:05.716371 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:40:05.716371 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:40:05.717377 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-3e8f231a-a271-4cea-9369-748db33c39d4 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:40:05.718114 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-3e8f231a-a271-4cea-9369-748db33c39d4 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Searching by: {'deleted': False, 'project_id': '8636fe098af34b33b41c75cf2f0072d5'} {{(pid=109169) get_all /opt/stack/nova/nova/compute/api.py:2905}} Oct 12 18:40:05.724474 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3e8f231a-a271-4cea-9369-748db33c39d4 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:40:05.724920 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3e8f231a-a271-4cea-9369-748db33c39d4 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:40:05.725712 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3e8f231a-a271-4cea-9369-748db33c39d4 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:40:05.726142 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-3e8f231a-a271-4cea-9369-748db33c39d4 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:40:05.967239 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.multi_cell_list [None req-3e8f231a-a271-4cea-9369-748db33c39d4 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=109169) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Oct 12 18:40:06.058223 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-3e8f231a-a271-4cea-9369-748db33c39d4 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.349091 Oct 12 18:40:06.058801 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 733/1460] 10.222.0.18 () {58 vars in 1124 bytes} [Tue Oct 12 18:40:05 2021] GET /compute/v2.1/servers => generated 343 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:40:06.068638 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-74f362ad-aecb-4172-a5c7-d4e05029acbb tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:40:06.069247 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-74f362ad-aecb-4172-a5c7-d4e05029acbb tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:40:06.075561 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-74f362ad-aecb-4172-a5c7-d4e05029acbb tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:40:06.076012 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-74f362ad-aecb-4172-a5c7-d4e05029acbb tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:40:06.076809 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-74f362ad-aecb-4172-a5c7-d4e05029acbb tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:40:06.077243 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-74f362ad-aecb-4172-a5c7-d4e05029acbb tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:40:06.192951 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-74f362ad-aecb-4172-a5c7-d4e05029acbb tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:40:06.200562 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-74f362ad-aecb-4172-a5c7-d4e05029acbb tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1548 microversion: 2.1 time: 0.135490 Oct 12 18:40:06.201116 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 728/1461] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:40:06 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1548 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:40:08.054443 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-047a50d2-71aa-4808-af3b-3e1d43f82a1e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d34bc06-6fc1-4205-bd05-b1e657d4b638"}} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:40:08.059921 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-047a50d2-71aa-4808-af3b-3e1d43f82a1e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:40:08.061505 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-047a50d2-71aa-4808-af3b-3e1d43f82a1e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:40:08.061941 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-047a50d2-71aa-4808-af3b-3e1d43f82a1e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:40:08.062718 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-047a50d2-71aa-4808-af3b-3e1d43f82a1e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:40:08.063142 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-047a50d2-71aa-4808-af3b-3e1d43f82a1e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:40:08.833942 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-047a50d2-71aa-4808-af3b-3e1d43f82a1e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "POST /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.783067 Oct 12 18:40:08.834547 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 734/1462] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Oct 12 18:40:08 2021] POST /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c/os-volume_attachments => generated 194 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:40:16.328293 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-85442021-417d-4175-b93d-2d8a174a0e05 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:40:16.328925 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-85442021-417d-4175-b93d-2d8a174a0e05 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:40:16.334712 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-85442021-417d-4175-b93d-2d8a174a0e05 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:40:16.335146 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-85442021-417d-4175-b93d-2d8a174a0e05 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:40:16.335899 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-85442021-417d-4175-b93d-2d8a174a0e05 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:40:16.336322 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-85442021-417d-4175-b93d-2d8a174a0e05 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:40:16.454054 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-85442021-417d-4175-b93d-2d8a174a0e05 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:40:16.461928 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-85442021-417d-4175-b93d-2d8a174a0e05 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1594 microversion: 2.1 time: 0.137774 Oct 12 18:40:16.462473 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 729/1463] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:40:16 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1594 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:40:18.647312 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-5127b6cb-ac10-4a34-ae9f-81094b4b12f5 req-bf3b09d8-e5ac-4f65-8f30-cd68bf04227c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23084c2f-601a-4de2-bf8f-25fce88ff02c", "tag": "8ab1a3fe-6549-471b-9b2a-fb824d78b666"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:40:18.649164 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:40:18.649164 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:40:18.657639 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-5127b6cb-ac10-4a34-ae9f-81094b4b12f5 req-bf3b09d8-e5ac-4f65-8f30-cd68bf04227c service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:40:18.659414 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-5127b6cb-ac10-4a34-ae9f-81094b4b12f5 req-bf3b09d8-e5ac-4f65-8f30-cd68bf04227c service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:40:18.669287 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-5127b6cb-ac10-4a34-ae9f-81094b4b12f5 req-bf3b09d8-e5ac-4f65-8f30-cd68bf04227c service nova] Creating event network-changed:8ab1a3fe-6549-471b-9b2a-fb824d78b666 for instance 23084c2f-601a-4de2-bf8f-25fce88ff02c on hv-cinder-81322 Oct 12 18:40:18.674221 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-5127b6cb-ac10-4a34-ae9f-81094b4b12f5 req-bf3b09d8-e5ac-4f65-8f30-cd68bf04227c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031688 Oct 12 18:40:18.674843 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 735/1464] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:40:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:40:21.176604 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a51ec6c1-8f89-4a77-9682-0519af9890aa tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-124172096"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:40:21.177133 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a51ec6c1-8f89-4a77-9682-0519af9890aa tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:40:21.182915 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a51ec6c1-8f89-4a77-9682-0519af9890aa tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:40:21.183363 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a51ec6c1-8f89-4a77-9682-0519af9890aa tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:40:21.184779 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a51ec6c1-8f89-4a77-9682-0519af9890aa tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:40:21.185203 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a51ec6c1-8f89-4a77-9682-0519af9890aa tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:40:21.299480 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.network.security_group_api [None req-a51ec6c1-8f89-4a77-9682-0519af9890aa tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Adding security group 10cc3a1d-7267-4369-8a4d-d361241151e1 to port 8ab1a3fe-6549-471b-9b2a-fb824d78b666 Oct 12 18:40:21.688137 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a51ec6c1-8f89-4a77-9682-0519af9890aa tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "POST /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c/action" status: 202 len: 0 microversion: 2.1 time: 0.515245 Oct 12 18:40:21.688967 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 730/1465] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:40:21 2021] POST /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c/action => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:40:21.700105 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-8aeb1cbe-4edc-4445-95c4-19512ca6ad36 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:40:21.701534 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-8aeb1cbe-4edc-4445-95c4-19512ca6ad36 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:40:21.704662 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-12e58947-9c43-4250-92bc-3e07968fa4ed req-80fe57c2-4823-4ce7-bbeb-e971ccadd9e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23084c2f-601a-4de2-bf8f-25fce88ff02c", "tag": "8ab1a3fe-6549-471b-9b2a-fb824d78b666"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:40:21.705491 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:40:21.705491 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:40:21.711740 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8aeb1cbe-4edc-4445-95c4-19512ca6ad36 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:40:21.712469 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8aeb1cbe-4edc-4445-95c4-19512ca6ad36 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:40:21.713419 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8aeb1cbe-4edc-4445-95c4-19512ca6ad36 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:40:21.714004 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-8aeb1cbe-4edc-4445-95c4-19512ca6ad36 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:40:21.717134 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-12e58947-9c43-4250-92bc-3e07968fa4ed req-80fe57c2-4823-4ce7-bbeb-e971ccadd9e1 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:40:21.717675 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-12e58947-9c43-4250-92bc-3e07968fa4ed req-80fe57c2-4823-4ce7-bbeb-e971ccadd9e1 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:40:21.730660 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-12e58947-9c43-4250-92bc-3e07968fa4ed req-80fe57c2-4823-4ce7-bbeb-e971ccadd9e1 service nova] Creating event network-changed:8ab1a3fe-6549-471b-9b2a-fb824d78b666 for instance 23084c2f-601a-4de2-bf8f-25fce88ff02c on hv-cinder-81322 Oct 12 18:40:21.736103 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-12e58947-9c43-4250-92bc-3e07968fa4ed req-80fe57c2-4823-4ce7-bbeb-e971ccadd9e1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037544 Oct 12 18:40:21.737436 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 731/1466] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:40:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:40:21.870056 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-8aeb1cbe-4edc-4445-95c4-19512ca6ad36 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:40:21.880541 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-8aeb1cbe-4edc-4445-95c4-19512ca6ad36 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1759 microversion: 2.1 time: 0.186888 Oct 12 18:40:21.881791 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 736/1467] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:40:21 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1759 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:41:19.328533 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7aac35e3-5f0d-4cc7-adc6-cf53a4e9b0f2 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:41:19.329555 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7aac35e3-5f0d-4cc7-adc6-cf53a4e9b0f2 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:41:19.335782 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7aac35e3-5f0d-4cc7-adc6-cf53a4e9b0f2 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:41:19.336230 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7aac35e3-5f0d-4cc7-adc6-cf53a4e9b0f2 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:41:19.337035 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7aac35e3-5f0d-4cc7-adc6-cf53a4e9b0f2 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:41:19.337471 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7aac35e3-5f0d-4cc7-adc6-cf53a4e9b0f2 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:41:19.506202 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7aac35e3-5f0d-4cc7-adc6-cf53a4e9b0f2 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "POST /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c/action" status: 202 len: 0 microversion: 2.1 time: 0.181493 Oct 12 18:41:19.506816 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 732/1468] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:41:19 2021] POST /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:41:19.514381 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-d61f1d48-280c-43a3-84f6-d1e7e0af7667 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:41:19.515808 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-d61f1d48-280c-43a3-84f6-d1e7e0af7667 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:41:19.521829 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d61f1d48-280c-43a3-84f6-d1e7e0af7667 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:41:19.522273 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d61f1d48-280c-43a3-84f6-d1e7e0af7667 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:41:19.523042 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d61f1d48-280c-43a3-84f6-d1e7e0af7667 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:41:19.523470 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-d61f1d48-280c-43a3-84f6-d1e7e0af7667 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:41:19.776271 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-d61f1d48-280c-43a3-84f6-d1e7e0af7667 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:41:19.784192 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-d61f1d48-280c-43a3-84f6-d1e7e0af7667 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1751 microversion: 2.1 time: 0.273322 Oct 12 18:41:19.784781 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 737/1469] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:41:19 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1751 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:41:20.802462 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a9143eb1-fc9e-4b1f-8e97-1f1818471e09 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:41:20.803154 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a9143eb1-fc9e-4b1f-8e97-1f1818471e09 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:41:20.809238 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a9143eb1-fc9e-4b1f-8e97-1f1818471e09 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:41:20.809686 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a9143eb1-fc9e-4b1f-8e97-1f1818471e09 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:41:20.810447 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a9143eb1-fc9e-4b1f-8e97-1f1818471e09 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:41:20.810882 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a9143eb1-fc9e-4b1f-8e97-1f1818471e09 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:41:20.981733 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a9143eb1-fc9e-4b1f-8e97-1f1818471e09 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:41:20.989771 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a9143eb1-fc9e-4b1f-8e97-1f1818471e09 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1756 microversion: 2.1 time: 0.191329 Oct 12 18:41:20.990325 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 733/1470] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:41:20 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1756 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:41:22.006747 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-2327d71d-fa1e-4473-9669-9fa92775a636 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:41:22.007296 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-2327d71d-fa1e-4473-9669-9fa92775a636 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:41:22.012998 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2327d71d-fa1e-4473-9669-9fa92775a636 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:41:22.013443 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2327d71d-fa1e-4473-9669-9fa92775a636 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:41:22.014195 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2327d71d-fa1e-4473-9669-9fa92775a636 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:41:22.014618 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-2327d71d-fa1e-4473-9669-9fa92775a636 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:41:22.137581 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-2327d71d-fa1e-4473-9669-9fa92775a636 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:41:22.145797 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-2327d71d-fa1e-4473-9669-9fa92775a636 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1756 microversion: 2.1 time: 0.142782 Oct 12 18:41:22.146349 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 738/1471] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:41:22 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1756 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:41:23.163436 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ba419f73-e056-41aa-a466-7ce32ddce9b6 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:41:23.164048 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ba419f73-e056-41aa-a466-7ce32ddce9b6 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:41:23.170142 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ba419f73-e056-41aa-a466-7ce32ddce9b6 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:41:23.170583 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ba419f73-e056-41aa-a466-7ce32ddce9b6 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:41:23.171348 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ba419f73-e056-41aa-a466-7ce32ddce9b6 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:41:23.171776 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ba419f73-e056-41aa-a466-7ce32ddce9b6 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:41:23.294306 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ba419f73-e056-41aa-a466-7ce32ddce9b6 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:41:23.301995 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ba419f73-e056-41aa-a466-7ce32ddce9b6 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1756 microversion: 2.1 time: 0.142692 Oct 12 18:41:23.302562 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 734/1472] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:41:23 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1756 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:41:24.318742 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-1463fd81-48cf-444c-8cea-058982f914f6 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:41:24.319373 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-1463fd81-48cf-444c-8cea-058982f914f6 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:41:24.325585 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1463fd81-48cf-444c-8cea-058982f914f6 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:41:24.326020 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1463fd81-48cf-444c-8cea-058982f914f6 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:41:24.326769 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1463fd81-48cf-444c-8cea-058982f914f6 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:41:24.327191 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-1463fd81-48cf-444c-8cea-058982f914f6 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:41:24.450864 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-1463fd81-48cf-444c-8cea-058982f914f6 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:41:24.458436 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-1463fd81-48cf-444c-8cea-058982f914f6 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1756 microversion: 2.1 time: 0.143330 Oct 12 18:41:24.458992 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 739/1473] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:41:24 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1756 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:41:25.475134 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-80dcf3cf-3d5e-4c2b-917c-38a49b343d82 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:41:25.475735 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-80dcf3cf-3d5e-4c2b-917c-38a49b343d82 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:41:25.481506 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-80dcf3cf-3d5e-4c2b-917c-38a49b343d82 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:41:25.481953 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-80dcf3cf-3d5e-4c2b-917c-38a49b343d82 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:41:25.482713 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-80dcf3cf-3d5e-4c2b-917c-38a49b343d82 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:41:25.483140 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-80dcf3cf-3d5e-4c2b-917c-38a49b343d82 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:41:25.604479 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-80dcf3cf-3d5e-4c2b-917c-38a49b343d82 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:41:25.612101 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-80dcf3cf-3d5e-4c2b-917c-38a49b343d82 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1756 microversion: 2.1 time: 0.140898 Oct 12 18:41:25.612682 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 735/1474] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:41:25 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1756 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:41:26.631115 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-9d3f9398-a3d8-4267-a5f6-f02c2265af4e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:41:26.631912 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-9d3f9398-a3d8-4267-a5f6-f02c2265af4e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:41:26.637813 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9d3f9398-a3d8-4267-a5f6-f02c2265af4e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:41:26.638244 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9d3f9398-a3d8-4267-a5f6-f02c2265af4e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:41:26.639008 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9d3f9398-a3d8-4267-a5f6-f02c2265af4e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:41:26.639415 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-9d3f9398-a3d8-4267-a5f6-f02c2265af4e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:41:26.760517 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-9d3f9398-a3d8-4267-a5f6-f02c2265af4e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:41:26.768270 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-9d3f9398-a3d8-4267-a5f6-f02c2265af4e tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1756 microversion: 2.1 time: 0.141394 Oct 12 18:41:26.768857 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 740/1475] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:41:26 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1756 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:41:27.785940 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5872d5b5-1aa7-42c0-bd4a-62e702bfc569 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:41:27.794224 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5872d5b5-1aa7-42c0-bd4a-62e702bfc569 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:41:27.794224 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5872d5b5-1aa7-42c0-bd4a-62e702bfc569 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:41:27.794224 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5872d5b5-1aa7-42c0-bd4a-62e702bfc569 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:41:27.794224 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5872d5b5-1aa7-42c0-bd4a-62e702bfc569 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:41:27.794622 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5872d5b5-1aa7-42c0-bd4a-62e702bfc569 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:41:27.912996 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5872d5b5-1aa7-42c0-bd4a-62e702bfc569 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:41:27.920596 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5872d5b5-1aa7-42c0-bd4a-62e702bfc569 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1756 microversion: 2.1 time: 0.138529 Oct 12 18:41:27.921150 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 736/1476] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:41:27 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1756 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:41:28.937924 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-10130440-16cc-4d08-9510-25b07e7a257c tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:41:28.938493 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-10130440-16cc-4d08-9510-25b07e7a257c tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:41:28.944269 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-10130440-16cc-4d08-9510-25b07e7a257c tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:41:28.944743 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-10130440-16cc-4d08-9510-25b07e7a257c tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:41:28.945503 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-10130440-16cc-4d08-9510-25b07e7a257c tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:41:28.945939 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-10130440-16cc-4d08-9510-25b07e7a257c tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:41:29.068925 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-10130440-16cc-4d08-9510-25b07e7a257c tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:41:29.076583 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-10130440-16cc-4d08-9510-25b07e7a257c tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1756 microversion: 2.1 time: 0.142308 Oct 12 18:41:29.077141 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 741/1477] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:41:28 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1756 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:41:30.093355 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8e3640a6-841f-4c15-8c4f-5090e1b803bc tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:41:30.093962 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8e3640a6-841f-4c15-8c4f-5090e1b803bc tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:41:30.099694 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8e3640a6-841f-4c15-8c4f-5090e1b803bc tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:41:30.100156 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8e3640a6-841f-4c15-8c4f-5090e1b803bc tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:41:30.100932 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8e3640a6-841f-4c15-8c4f-5090e1b803bc tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:41:30.101363 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8e3640a6-841f-4c15-8c4f-5090e1b803bc tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:41:30.220256 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8e3640a6-841f-4c15-8c4f-5090e1b803bc tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:41:30.227837 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8e3640a6-841f-4c15-8c4f-5090e1b803bc tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1756 microversion: 2.1 time: 0.138154 Oct 12 18:41:30.228388 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 737/1478] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:41:30 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1756 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:41:31.244473 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-c6e1dd8c-5371-4358-8fbd-953d1fc3c910 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:41:31.245078 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-c6e1dd8c-5371-4358-8fbd-953d1fc3c910 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:41:31.250779 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c6e1dd8c-5371-4358-8fbd-953d1fc3c910 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:41:31.251217 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c6e1dd8c-5371-4358-8fbd-953d1fc3c910 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:41:31.251971 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c6e1dd8c-5371-4358-8fbd-953d1fc3c910 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:41:31.252415 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-c6e1dd8c-5371-4358-8fbd-953d1fc3c910 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:41:31.370701 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-c6e1dd8c-5371-4358-8fbd-953d1fc3c910 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:41:31.378374 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-c6e1dd8c-5371-4358-8fbd-953d1fc3c910 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1759 microversion: 2.1 time: 0.137602 Oct 12 18:41:31.378934 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 742/1479] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:41:31 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1759 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:42:14.215247 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 18:42:14.215855 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: Tue Oct 12 18:42:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 12 18:42:22.434197 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 18:42:22.434837 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: Tue Oct 12 18:42:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 12 18:42:30.888010 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 18:42:30.888488 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: Tue Oct 12 18:42:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 12 18:42:34.734706 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9e901ab8-6c7c-4be3-9fe3-887af90cf29a tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-124172096"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:42:34.735375 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9e901ab8-6c7c-4be3-9fe3-887af90cf29a tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:42:34.743691 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9e901ab8-6c7c-4be3-9fe3-887af90cf29a tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:42:34.744131 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9e901ab8-6c7c-4be3-9fe3-887af90cf29a tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:42:34.744917 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9e901ab8-6c7c-4be3-9fe3-887af90cf29a tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:42:34.745339 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9e901ab8-6c7c-4be3-9fe3-887af90cf29a tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:42:34.864804 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.network.security_group_api [None req-9e901ab8-6c7c-4be3-9fe3-887af90cf29a tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Removing security group 10cc3a1d-7267-4369-8a4d-d361241151e1 from port 8ab1a3fe-6549-471b-9b2a-fb824d78b666 Oct 12 18:42:35.237857 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9e901ab8-6c7c-4be3-9fe3-887af90cf29a tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "POST /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c/action" status: 202 len: 0 microversion: 2.1 time: 0.507920 Oct 12 18:42:35.251331 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 738/1480] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 12 18:42:34 2021] POST /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c/action => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:42:35.335428 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-b291d596-9d1e-4269-8f87-3956ee2102bc req-f825d80e-dca0-4a39-bc4b-8faed211d8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23084c2f-601a-4de2-bf8f-25fce88ff02c", "tag": "8ab1a3fe-6549-471b-9b2a-fb824d78b666"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:42:35.337224 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:42:35.337224 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:42:35.348276 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-b291d596-9d1e-4269-8f87-3956ee2102bc req-f825d80e-dca0-4a39-bc4b-8faed211d8e5 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:42:35.349024 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-b291d596-9d1e-4269-8f87-3956ee2102bc req-f825d80e-dca0-4a39-bc4b-8faed211d8e5 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:42:35.360891 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-b291d596-9d1e-4269-8f87-3956ee2102bc req-f825d80e-dca0-4a39-bc4b-8faed211d8e5 service nova] Creating event network-changed:8ab1a3fe-6549-471b-9b2a-fb824d78b666 for instance 23084c2f-601a-4de2-bf8f-25fce88ff02c on hv-cinder-81322 Oct 12 18:42:35.367125 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-b291d596-9d1e-4269-8f87-3956ee2102bc req-f825d80e-dca0-4a39-bc4b-8faed211d8e5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122374 Oct 12 18:42:35.368518 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 743/1481] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:42:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:42:36.462019 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a3cf4294-d1d0-4d80-ae3b-f6b4863431cb tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:42:36.462531 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a3cf4294-d1d0-4d80-ae3b-f6b4863431cb tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:42:36.468765 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a3cf4294-d1d0-4d80-ae3b-f6b4863431cb tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:42:36.469213 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a3cf4294-d1d0-4d80-ae3b-f6b4863431cb tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:42:36.469970 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a3cf4294-d1d0-4d80-ae3b-f6b4863431cb tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:42:36.470400 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a3cf4294-d1d0-4d80-ae3b-f6b4863431cb tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:42:36.546743 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-a3cf4294-d1d0-4d80-ae3b-f6b4863431cb tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lazy-loading 'services' on Instance uuid 23084c2f-601a-4de2-bf8f-25fce88ff02c {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 18:42:36.759101 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a3cf4294-d1d0-4d80-ae3b-f6b4863431cb tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "DELETE /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c/os-volume_attachments/5d34bc06-6fc1-4205-bd05-b1e657d4b638" status: 202 len: 0 microversion: 2.1 time: 0.300172 Oct 12 18:42:36.764568 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 739/1482] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Oct 12 18:42:36 2021] DELETE /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c/os-volume_attachments/5d34bc06-6fc1-4205-bd05-b1e657d4b638 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:42:36.769914 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-df69921d-f084-48a2-bfc7-2119d6af3c84 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:42:36.770932 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-df69921d-f084-48a2-bfc7-2119d6af3c84 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:42:36.777277 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-df69921d-f084-48a2-bfc7-2119d6af3c84 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:42:36.777722 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-df69921d-f084-48a2-bfc7-2119d6af3c84 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:42:36.778497 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-df69921d-f084-48a2-bfc7-2119d6af3c84 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:42:36.778926 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-df69921d-f084-48a2-bfc7-2119d6af3c84 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:42:36.809991 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-df69921d-f084-48a2-bfc7-2119d6af3c84 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044870 Oct 12 18:42:36.810595 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 744/1483] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Oct 12 18:42:36 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 18:42:37.393825 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-f35f3c08-dc1f-4460-bc35-8f1c53e14ecc req-ea9bf62d-36af-468a-84a3-b0eb1732e101 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23084c2f-601a-4de2-bf8f-25fce88ff02c", "tag": "8ab1a3fe-6549-471b-9b2a-fb824d78b666"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:42:37.395397 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:42:37.395397 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Oct 12 18:42:37.402674 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-f35f3c08-dc1f-4460-bc35-8f1c53e14ecc req-ea9bf62d-36af-468a-84a3-b0eb1732e101 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:42:37.403114 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-f35f3c08-dc1f-4460-bc35-8f1c53e14ecc req-ea9bf62d-36af-468a-84a3-b0eb1732e101 service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:42:37.414192 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-f35f3c08-dc1f-4460-bc35-8f1c53e14ecc req-ea9bf62d-36af-468a-84a3-b0eb1732e101 service nova] Creating event network-changed:8ab1a3fe-6549-471b-9b2a-fb824d78b666 for instance 23084c2f-601a-4de2-bf8f-25fce88ff02c on hv-cinder-81322 Oct 12 18:42:37.418953 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-f35f3c08-dc1f-4460-bc35-8f1c53e14ecc req-ea9bf62d-36af-468a-84a3-b0eb1732e101 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029565 Oct 12 18:42:37.420591 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 740/1484] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:42:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:42:37.821898 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-5b4d77db-7442-4a4d-b8dc-2ea1bc840c19 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:42:37.822797 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-5b4d77db-7442-4a4d-b8dc-2ea1bc840c19 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:42:37.828780 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5b4d77db-7442-4a4d-b8dc-2ea1bc840c19 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:42:37.829260 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5b4d77db-7442-4a4d-b8dc-2ea1bc840c19 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:42:37.830022 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5b4d77db-7442-4a4d-b8dc-2ea1bc840c19 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:42:37.830447 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-5b4d77db-7442-4a4d-b8dc-2ea1bc840c19 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:42:37.862819 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-5b4d77db-7442-4a4d-b8dc-2ea1bc840c19 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044904 Oct 12 18:42:37.863382 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 745/1485] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Oct 12 18:42:37 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 18:42:37.873744 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3c375e6d-ede3-4aae-8487-ab40db288bdd tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:42:37.874426 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3c375e6d-ede3-4aae-8487-ab40db288bdd tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:42:37.880304 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3c375e6d-ede3-4aae-8487-ab40db288bdd tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:42:37.880783 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3c375e6d-ede3-4aae-8487-ab40db288bdd tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:42:37.881594 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3c375e6d-ede3-4aae-8487-ab40db288bdd tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:42:37.882027 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3c375e6d-ede3-4aae-8487-ab40db288bdd tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:42:37.954700 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-3c375e6d-ede3-4aae-8487-ab40db288bdd tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] HTTP exception thrown: Instance 23084c2f-601a-4de2-bf8f-25fce88ff02c is not attached to volume 5d34bc06-6fc1-4205-bd05-b1e657d4b638 Oct 12 18:42:37.955344 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3c375e6d-ede3-4aae-8487-ab40db288bdd tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Returning 404 to user: Instance 23084c2f-601a-4de2-bf8f-25fce88ff02c is not attached to volume 5d34bc06-6fc1-4205-bd05-b1e657d4b638 {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:42:37.956233 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3c375e6d-ede3-4aae-8487-ab40db288bdd tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "DELETE /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c/os-volume_attachments/5d34bc06-6fc1-4205-bd05-b1e657d4b638" status: 404 len: 154 microversion: 2.1 time: 0.086806 Oct 12 18:42:37.956814 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 741/1486] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Oct 12 18:42:37 2021] DELETE /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c/os-volume_attachments/5d34bc06-6fc1-4205-bd05-b1e657d4b638 => generated 154 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 18:42:39.196910 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-0cf8d75c-1672-4937-9b59-93c3299aa8fc tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:42:39.197398 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-0cf8d75c-1672-4937-9b59-93c3299aa8fc tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:42:39.203753 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0cf8d75c-1672-4937-9b59-93c3299aa8fc tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:42:39.204187 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0cf8d75c-1672-4937-9b59-93c3299aa8fc tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:42:39.204965 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0cf8d75c-1672-4937-9b59-93c3299aa8fc tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:42:39.205389 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-0cf8d75c-1672-4937-9b59-93c3299aa8fc tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:42:39.228190 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-0cf8d75c-1672-4937-9b59-93c3299aa8fc tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Going to try to terminate instance {{(pid=109169) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 18:42:39.466550 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-0cf8d75c-1672-4937-9b59-93c3299aa8fc tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "DELETE /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 204 len: 0 microversion: 2.1 time: 0.272897 Oct 12 18:42:39.467054 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 746/1487] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Oct 12 18:42:39 2021] DELETE /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 18:42:39.475377 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-680db761-4d3b-4183-b05e-c80f8c96d3a7 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:42:39.475983 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-680db761-4d3b-4183-b05e-c80f8c96d3a7 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:42:39.481710 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-680db761-4d3b-4183-b05e-c80f8c96d3a7 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:42:39.482201 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-680db761-4d3b-4183-b05e-c80f8c96d3a7 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:42:39.482909 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-680db761-4d3b-4183-b05e-c80f8c96d3a7 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:42:39.483335 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-680db761-4d3b-4183-b05e-c80f8c96d3a7 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:42:39.604944 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-680db761-4d3b-4183-b05e-c80f8c96d3a7 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:42:39.612151 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-680db761-4d3b-4183-b05e-c80f8c96d3a7 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1554 microversion: 2.1 time: 0.140452 Oct 12 18:42:39.612734 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 742/1488] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:42:39 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1554 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:42:40.629544 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-42de9aff-c9db-4a6c-8903-f3fec3d4c828 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:42:40.630233 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.compute.api [None req-42de9aff-c9db-4a6c-8903-f3fec3d4c828 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109169) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:42:40.635938 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-42de9aff-c9db-4a6c-8903-f3fec3d4c828 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:42:40.636372 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-42de9aff-c9db-4a6c-8903-f3fec3d4c828 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:42:40.637149 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-42de9aff-c9db-4a6c-8903-f3fec3d4c828 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:42:40.637576 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [None req-42de9aff-c9db-4a6c-8903-f3fec3d4c828 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:42:40.753956 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.policy [None req-42de9aff-c9db-4a6c-8903-f3fec3d4c828 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109169) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:42:40.761243 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-42de9aff-c9db-4a6c-8903-f3fec3d4c828 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1554 microversion: 2.1 time: 0.135741 Oct 12 18:42:40.761806 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 747/1489] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:42:40 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1554 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:42:41.777921 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-cf4a3fca-7027-42b9-b3dd-ab001557c4a5 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:42:41.778566 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-cf4a3fca-7027-42b9-b3dd-ab001557c4a5 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:42:41.785066 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cf4a3fca-7027-42b9-b3dd-ab001557c4a5 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:42:41.793129 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cf4a3fca-7027-42b9-b3dd-ab001557c4a5 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:42:41.793129 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cf4a3fca-7027-42b9-b3dd-ab001557c4a5 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:42:41.793129 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cf4a3fca-7027-42b9-b3dd-ab001557c4a5 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:42:41.847756 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-cf4a3fca-7027-42b9-b3dd-ab001557c4a5 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80631cd055354ed8ba8fa7888e4e319c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636fe098af34b33b41c75cf2f0072d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 18:42:41.855470 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-cf4a3fca-7027-42b9-b3dd-ab001557c4a5 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 200 len: 1512 microversion: 2.1 time: 0.081298 Oct 12 18:42:41.856428 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 743/1490] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:42:41 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 1512 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 18:42:41.901715 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [req-c868ccec-4abf-493f-87d8-c2542748aaf6 req-16f4ffd0-1cb5-4e8d-9669-6907703dcf5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23084c2f-601a-4de2-bf8f-25fce88ff02c", "name": "network-vif-deleted", "tag": "8ab1a3fe-6549-471b-9b2a-fb824d78b666"}]} {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 18:42:41.903241 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 18:42:41.903241 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: warnings.warn(msg) Oct 12 18:42:41.910941 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-c868ccec-4abf-493f-87d8-c2542748aaf6 req-16f4ffd0-1cb5-4e8d-9669-6907703dcf5a service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:42:41.911413 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG oslo_concurrency.lockutils [req-c868ccec-4abf-493f-87d8-c2542748aaf6 req-16f4ffd0-1cb5-4e8d-9669-6907703dcf5a service nova] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:42:41.922012 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.compute.server_external_events [req-c868ccec-4abf-493f-87d8-c2542748aaf6 req-16f4ffd0-1cb5-4e8d-9669-6907703dcf5a service nova] Creating event network-vif-deleted:8ab1a3fe-6549-471b-9b2a-fb824d78b666 for instance 23084c2f-601a-4de2-bf8f-25fce88ff02c on hv-cinder-81322 Oct 12 18:42:41.926786 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [req-c868ccec-4abf-493f-87d8-c2542748aaf6 req-16f4ffd0-1cb5-4e8d-9669-6907703dcf5a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028751 Oct 12 18:42:41.927447 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 748/1491] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 12 18:42:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 18:42:42.872419 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4aec4724-e89a-4c2b-b84e-4327c638a932 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:42:42.873046 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4aec4724-e89a-4c2b-b84e-4327c638a932 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] [instance: 23084c2f-601a-4de2-bf8f-25fce88ff02c] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 18:42:42.878649 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4aec4724-e89a-4c2b-b84e-4327c638a932 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:42:42.879088 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4aec4724-e89a-4c2b-b84e-4327c638a932 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:42:42.879844 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4aec4724-e89a-4c2b-b84e-4327c638a932 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 18:42:42.880265 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4aec4724-e89a-4c2b-b84e-4327c638a932 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Lock "795c300a-6d2e-4a0e-badc-5da7a18d8918" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 18:42:42.893133 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-4aec4724-e89a-4c2b-b84e-4327c638a932 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] HTTP exception thrown: Instance 23084c2f-601a-4de2-bf8f-25fce88ff02c could not be found. Oct 12 18:42:42.893702 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4aec4724-e89a-4c2b-b84e-4327c638a932 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Returning 404 to user: Instance 23084c2f-601a-4de2-bf8f-25fce88ff02c could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 18:42:42.894498 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4aec4724-e89a-4c2b-b84e-4327c638a932 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c" status: 404 len: 111 microversion: 2.1 time: 0.025879 Oct 12 18:42:42.895009 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 744/1492] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Oct 12 18:42:42 2021] GET /compute/v2.1/servers/23084c2f-601a-4de2-bf8f-25fce88ff02c => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 18:42:42.903370 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: DEBUG nova.api.openstack.wsgi [None req-4df741e4-9a24-419f-b70d-b9b091992256 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] Calling method '.version_select at 0x7fe297d3faf0>' {{(pid=109169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 18:42:43.010683 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO nova.api.openstack.requestlog [None req-4df741e4-9a24-419f-b70d-b9b091992256 tempest-TestMinimumBasicScenario-976487348 tempest-TestMinimumBasicScenario-976487348-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-433301441" status: 202 len: 0 microversion: 2.1 time: 0.111228 Oct 12 18:42:43.011261 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: [pid: 109169|app: 0|req: 749/1493] 10.222.0.18 () {58 vars in 1268 bytes} [Tue Oct 12 18:42:42 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-433301441 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 18:45:34.233234 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 18:45:34.233900 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: Tue Oct 12 18:45:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 12 18:45:42.410510 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 18:45:42.411160 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: Tue Oct 12 18:45:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 12 18:45:42.450752 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 18:45:42.451311 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: Tue Oct 12 18:45:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 12 18:45:50.906361 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 18:45:50.906920 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: Tue Oct 12 18:45:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 12 18:47:46.168911 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 18:47:46.169812 dv-cinder-813227-2-iscsi devstack@n-api.service[109168]: Tue Oct 12 18:47:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 12 18:47:47.777463 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 18:47:47.778300 dv-cinder-813227-2-iscsi devstack@n-api.service[109169]: Tue Oct 12 18:47:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!